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There is no doubt that education is changing with the times. Our reality is characterised 
by instability and diversity, globalization/deglobalization, cultural resilience/non-resilience, 
fragmentation and transformation, etc. Education, in general, is a very complex aspect of 
human activity; it is a constantly transforming activity. Only comprehensive knowledge of 
education systems (and education as a system) guarantees effective educational changes in 
them (Lamanauskas, 2004). It can be understood as the result of the continuous interaction 
of personal development and experience throughout life. Education is precisely a complex 
system that includes many related elements and is conditioned by even more external factors 
(Vaitkevicius, 1988). On the other hand, it requires quite a lot of various resources. Obviously, 
today’s/current cognition is highly specialised. However, there is no such science that can 
provide answers to all questions. Systematic cognition becomes one of the most important 
methodological principles. According to Karosas (1989), it is relevant for all cognition to 
constantly combine concrete experience and special knowledge with the historical context of all 
cognition. Finally, even in a specific branch of science, indefeasible stereotypes and limitations 
are being formed, negatively affecting universal, holistic cognition. As Wiener (1958, p. 160) 
states, "few scientists nowadays can call themselves mathematicians, physicists or biologists, 
without adding a further limitation to such a description...”. Identifying the paradigmatic 
structure of modern education remains complex and problematic because education is like 
a mosaic of theoretical /methodological and practical approaches. This inevitably requires 
a systematic approach. The fundamental aim remains clear, that is, the organisation of such 
education that can ensure the effective socio-cultural and material growth/improvement of 
the society. As soon as we try to analyse current (and future) education, obvious difficulties 
arise, primarily the multi-paradigm nature of education as a socio-cultural phenomenon and 
paradigm shifts. Therefore, multi-paradigm education seems to become even more valuable 
in a constantly changing and uncertain world (Ardalan, 2023), moreover, a multi-paradigm 
approach can provide more insights than any single approach (Peca, 2001). A multi-paradigm 
position in education primarily refers to an approach that includes and evaluates various 
theoretical systems, methodologies and educational strategies. Rather than strictly adhering to 
a single educational paradigm, such a perspective recognises that different paradigms provide 
unique insights and obvious advantages that can be useful in addressing various educational 
issues and in organising and implementing a complex educational process. 

Thus, multiparadigm education is a process that integrates several educational paradigms 
and/or attitudes to education. This means that various learning theories and methods/techniques 
are used in the educational process to better meet the learners’ needs, abilities, attitudes, and 
interests. This includes the use of different teaching/learning methods, individualisation/ 
personalisation and differentiation, critical thinking and creativity, interdisciplinary functioning 
and position, and of course, values and social skills. Multiparadigmatic education aims to 
create a more flexible, efficient and dynamic teaching/learning environment that can better 
meet the changing needs and challenges of the modern world. Multiparadigmatic education 
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is inseparable from the holistic approach (comprehensiveness and harmony). It is not a static 
model but a constantly changing and, at the same time, adaptive process. The most significant 
paradigm shifts are expressed in Figure 1. 


Figure 1 
Multiparadigm Shifts 
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It is obvious that the main problem of current education is its inadequacy to the structures 
of modern culture and human activity. The position of a modern educator is to be (become) 
a mediator between the student and culture. On the other hand, culture can be perceived as 
polysystemic education, accumulating in itself the most diverse contradictions of different 
epochs, various approaches to world cognition and interpretation, etc. Such a position can indeed 
be considered rational. It is completely understandable that each epoch has its own educational 
goals, based on certain paradigms. It is commonly said that the previously prevailing paradigm 
does not meet the requirements of the times, and it is necessary to change it. For example, in 
Lithuania, the transition from education to the paradigm of education has been discussed for 
several years. It is also obvious that the educational process can be based on different theoretical 
foundations and different models. The choice of the model of the educational process depends 
on the orientation of the goal and content of education, the forms and methods of education 
(upbringing), as well as on the nature of the interaction between educators and students. Any 
educational model is formed in a certain paradigm. On the other hand, we are all different, 
so you cannot use the same criteria and standards for everyone. The abilities of students are 
different, and the level of thinking and receptivity to knowledge differs. Is it possible to have 
one exclusive paradigm rejecting all others? Is it reasonable to absolutely accept the prevailing 
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paradigm? After all, researchers usually seek to expand the boundaries of a specific paradigm 
referring to the recent studies and looking over the existing theories. According to Kuhn (1996), 
this results in unsolvable theoretical problems or experimental anomalies, demonstrating 
inadequacy or contradiction of paradigms. For example, are new technologies (artificial 
intelligence) really becoming an alternative to the classical educational paradigm? In former 
times, writing was an undisputed paradigmatic novelty in ancient Greece. If once Gutenberg 
swept away scholasticism and handwriting culture almost overnight (McLuhan, 1966), will 
artificial intelligence sweep away current paradigms even faster? The question is open. 

Thus, a paradigm (gr. paradeigma —an example) is a set of theoretical and methodological 
assumptions on which a specific scientific study is based; an example from history used for 
proof, comparison. Currently, the educational paradigm is defined as the whole of scientific 
attitudes to the educational process, ideals and values of education, ways of organising 
education, etc., in a particular culture/society. And such a treatment is justified. It is important to 
understand how such fundamental issues as ideals, values, educational goals and ways of their 
implementation enter/integrate into a specific paradigm. One thing is clear: you can teach as 
long as you are learning. Educators can never be sure of the consequences and results of their 
actions. Multiparadigmatic training of educators for the future is becoming more important than 
ever (Cramer et al., 2023). Thus, the modern analysis of educational problems is inevitably 
associated with a multiparadigmatic approach and position. Knowing how the educational 
system changes (or would change) with the change of one or another educational paradigm, 
remains an essential matter. 
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Abstract 


English academic writing is fundamental at tertiary level as it is the main medium of communication 
in the academe. Over the years, ESL lecturers have not only struggled to search for the most suitable 
teaching approach(es) to teach academic writing but have encountered several other problems in their 
teaching, such as class size, students’ English proficiency levels, heavy workload, and others. Given these 
circumstances, a review of the literature has indicated there are scant studies that explore the problems 


faced by ESL lecturers where comparisons are made between public and private universities. Grounded 


in multiple case studies, four ESL lecturers from two public and two private Malaysian universities were 
purposively selected for the study. Data were collected from semi-structured in-depth interviews, lesson 
observations, and document analysis. A total of 12 interview transcripts were transcribed verbatim by 
the researchers, and data were analysed thematically using thematic analysis and cross-case analysis, 
where emerging themes were used to present the findings. Findings reveal that ESL lecturers at higher 
education institutions encountered problems, such as constraints in time, marking issues, students ’lack of 
interests and motivations, lecturers’ lack of interest in writing, lecturers’ lack of content and pedagogical 
content knowledge, and lack of institutional support. Hence, professional support should be given to 
ESL lecturers to overcome their teaching problems, and future research should explore the strategies 
employed by ESL lecturers to alleviate their teaching problems. 

Keywords: ESL/EFL lecturers, English academic writing, qualitative case study 


Introduction 


English academic writing is a type of formal writing that is written based on its academic 
conventions for the purpose of sharing academic information and knowledge in the educational 
context. In tertiary education in Malaysia, proficiency in academic writing skills is considered 
pivotal for students. It serves as the primary means of written communication for the writers 
(Yuvayapan & Rathert, 2018) in showcasing their points of view to the readers. Ratnawati et al. 
(2018) have asserted that skills in academic writing are essential for Malaysian students not only 
for their studies but also for their future endeavours as these skills help the students to polish 
and enhance their critical and analytical thinking skills while producing their piece of academic 
writing. Albeit its importance for education at tertiary level, majority of English as a Second 
Language (ESL) and English as a Foreign Language (EFL) students view academic writing as 
demanding skills compared to other language skills (Haerazi et al., 2018). This is due to the 
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technical aspects of academic writing which demand academic writers to have good knowledge 
of English language (1.e., grammar), the ability to construct meaningful sentences in English 
language, use of academic vocabulary, mechanics of writing (1.e., spelling, punctuations, etc.), 
and use of referencing for published works. With these aspects, English academic writing has 
been portrayed as not only challenging to learn among the students but also a daunting skill 
to teach among the ESL lecturers. ESL lecturers have lamented that writing instruction is a 
daunting task and requires a lot of effort (Maarof et al., 2011) as there are many elements and 
parts of writing that need to be mastered and taught to students. Additionally, dealing with 
students’ lack of interest in writing skills is also one of the problems circling teaching academic 
writing. Akhtar et al. (2020) have reiterated that most ESL students regarded academic writing 
as uninteresting and challenging skills due to many facets of writing skills to be mastered and 
consequently portrayed negative perceptions and dislike towards the skills. 

Therefore, ESL lecturers not only need to equip themselves with ample content knowledge 
of English academic writing, but they also need to have the required pedagogical skills to teach 
such technical skills. This is because teaching writing at tertiary level is much more demanding 
than teaching writing at school level. ESL lecturers are not only need to educate their students 
on the conventions of English academic writing (i.e., use of formal writing style, formal tone, 
correct use of grammar, academic vocabulary, mechanics of writing, and referencing) but they 
also need to instil the importance of learning and acquiring academic writing skills among their 
students. As a result, teaching English academic writing has never been an easy task for most 
ESL/EFL lecturers, especially in Malaysia, where English is considered a second language to 
many and a foreign language to few. These circumstances have motivated the researchers to 
conduct a study by exploring the problems faced by ESL lecturers in teaching English academic 
writing at higher education institutions, particularly in the Malaysian tertiary education context. 


Research Problem 


In a study by Hajan et al. (2019), ESL teachers viewed academic writing as a complex 
process that required many skills. Some of the constraints that these teachers encountered in 
teaching English academic writing were related to insufficient class time to complete their 
lectures as teaching writing is a tedious task. Additionally, several other problems, such as 
attitude and motivation of students to learn English academic writing, a high number of students 
in a class, and insufficient and poor school facilities, especially lack of adequate technology 
have hampered the teaching delivery of English academic writing lessons in the classroom. 

On top of that, lecturers’ lack of creativity and sharing of cultures in academic writing 
was also one of the important issues highlighted in the previous study. According to Joshi 
(2017), lack of exposure and involvement in academic writing, such as writing term papers, 
book reviews, and research articles among ESL lecturers, led them to lack experience in 
publication and presenting papers at conferences. As a result, ESL lecturers are unable to 
instil the importance and culture of English academic writing among the students. Another 
compelling issue is the lack of content knowledge in academic writing among ESL lecturers. In 
a study by Roxas (2020), ESL lecturers were found to conduct their English academic writing 
classes using unclear lesson instructions and lacked knowledge on unfamiliar vocabulary due 
to their lack of content and pedagogical knowledge. Consequently, this has impeded students’ 
understanding in learning English academic writing. 

Abdullah, and Majid (2013) reiterated that inadequate knowledge on ESL teaching 
was one of the factors that contributed to the challenges in teaching academic writing. They 
further accentuated that dealing with low level of English proficiency among the students was 
another never-ending issue for majority of ESL lecturers when teaching the demanding skills of 
academic writing. This finding is in tandem with a study by Kamaruddin and Abdullah (2015) 
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where they mentioned that insufficient content knowledge and pedagogical skills among new 
or young ESL lecturers were one of the problems in teaching English academic writing. This 
is further mentioned by Kwan and Yunus (2014) and Yunus and Chan (2016) that the lack of 
content knowledge among ESL lecturers in English academic writing was one of the prevailing 
issues in teaching academic writing. It was noted that ESL lecturers who have incompetency 
in English language and lack knowledge of academic writing conventions tend to pass down 
the errors to their students, and consequently, students learn to adopt these errors in their own 
writing. 

In Malaysian tertiary education context, ESL lecturers also face problems in teaching 
English academic writing. One of the most prevalent problems is dealing with students’ 
low proficiency in English language. Although Malaysian students have been exposed and 
introduced to the English language since young, as English is regarded as a second language 
in Malaysia, not many of them are able to acquire proficiency at an acceptable level. Majority 
of Malaysian students do not use English language in their daily communication, at school, at 
university, and at home (Singh, 2019). Due to this, students are unable to maintain good use of 
English language in their studies. 

This finding is consistent with those of Zamin et al. (2018), who explored the experiences 
of novice ESL lecturers in teaching English academic writing. Two main challenges were 
found, which were lack of teaching experience at tertiary level and lack of content knowledge 
in research writing. These novice ESL lecturers admitted to having limited knowledge in 
referencing styles and writing literature reviews. They also expressed fear about teaching 
English academic writing, considering it as a challenging and technical course to teach. In 
another study by Ibrahim et al. (2017), they mentioned four main problems that ESL lecturers 
encountered when teaching English academic writing. These problems were related to the 
attitude of ESL lecturers, lack of content knowledge and pedagogical skills, inappropriate use 
of teaching strategies, and inappropriate writing assessments. These findings are also mentioned 
in a study by Alabere and Shapii (2019) at a public university in Malaysia where underqualified, 
unprepared and lack of experience among ESL lecturers are some of the problems affecting the 
teaching of English academic writing. 

Based on the reviews of literature, there is a dearth of studies conducted in Malaysian 
tertiary education context that closely focus on the problems encountered by ESL lecturers in 
teaching English academic writing at public and private universities using qualitative multiple 
case study approach. Findings from this study would bring significant impact to the field of 
teaching and learning, especially English academic writing where potential ways and strategies 
are proposed to alleviate the teaching problems and thus help ESL lecturers to bridge the 
practice gap in enhancing students’ academic writing. 


Research Aim and Research Question 


The study aimed to explore the problems faced by ESL lecturers in teaching English 
academic writing in Malaysian tertiary context at public and private universities. Conducting 
a comparison study at these research settings (public and private universities) would help the 
researchers to provide in-depth findings on the phenomenon of teaching English academic 
writing to the body of literature. The study was guided by the following research question; 
What are the problems faced by ESL lecturers in teaching English academic writing at higher 
education institutions in Malaysia? 
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General Background 


The study is grounded in a qualitative multiple case study approach. The case study 
approach is deemed as suitable research approach as it allows the researchers to explore the 
phenomenon in its natural settings (Creswell & Poth, 2018; Yin, 2018). In relation to the study, 
the researchers explored the problems surrounding the teaching of English academic writing 
faced by ESL lecturers in Malaysian tertiary education context, specifically at public and 
private universities. In line with this methodological stance, Yin’s replication of logic (1994) 
was employed by the researchers in which similar research procedures were replicated for 
each case to maintain consistency and standardization in conducting multiple case studies. The 
study involved ESL lecturers who are teaching English academic writing course at public and 
private universities in Malaysia. Data collection process started in the first academic semester 
of 2022/2023, precisely from November 2022 until May 2023, at two public and two private 
universities. 


Sample 


The study involves four ESL lecturers who are teaching English academic writing course 
in higher education institutions at public and private universities in Malaysia. These numbers 
(i.e., four ESL lecturers) are considered appropriate for case study approach as case study does 
not require huge numbers of participants compared to quantitative study. Moreover, findings 
from case study approach focus on particularizing the phenomenon under exploration, and 
the findings are not used to generalize the population (Yin, 1994). These ESL lecturers were 
selected purposively by the researchers based on the selection criteria, such as: (1) possessing 
at least Master's degree in the field of ESL or any related field, (2) teaching English academic 
writing to undergraduate students, (3) having a minimum of two years teaching experience at 
tertiary level, and (4) a permanent academic staff. These ESL lecturers were then provided with 
informed consent forms to indicate their voluntary participation in the study. Pseudonyms were 
used to ensure the anonymity of the participants and the institutions’ details. The participants’ 
demographic information is presented in the table below. 


Table 1 
Participants’ Demographic Details 


ESL Lecturers weprsiet 
Gender Age Academic Qualifications Institutions teaching 
(pseudonyms) é 
experience 
Ms. Siti Female 36 Master (Teaching English as a Second Public 9 
Language) University A 
aes Public 
Mr. Yash Male 33 Master (Linguistics) University B 7 
: oe Private 
Mr. Ray Male 33 Master (English and Communication) University A 6 
, Private 
Ms. Ana Female 29 Master (English as Second Language) University B 2 
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Research Instruments 


Case study approach relies heavily on the use of multiple instruments to corroborate and 
strengthen the findings (Merriam & Tisdell, 2016). Qualitative research instruments, such as 
semi-structured in-depth interviews, lesson observations, and document analysis were used to 
collect data for the study. Semi-structured in-depth interviews and a set of probing questions 
were developed by the researchers and were validated by two experts in the field of TESL. 
Semi-structured interviews were used by the researchers to help yield rich data to understand 
the experience of the participants, their explanations on the experiences, and how they construct 
meanings out of those experiences (Rubin & Rubin, 2012). The interview sessions with each 
ESL lecturer were conducted face-toface for three times at the beginning, middle, and end 
of the study. Along with that, four times of lesson observations were also conducted with 
each ESL lecturer at their respective institutions, where the researchers opted for the role of 
non-participant observer while observing the teaching of English academic writing in the 
classrooms. The researchers noted down descriptive and reflective notes while conducting the 
lesson observations. Lesson observations were conducted to help provide further information 
on specific incidents that can be used by the researchers as a reference for subsequent interviews 
with the participants (Merriam & Tisdell, 2016). Lastly, documents, such as course syllabus/ 
scheme of work, teaching schedules, and samples of assessments were also collected from 
each case and analysed to help strengthen the findings. Merriam (1988) asserted that the use of 
document analysis helps the researcher to understand and interpret the meaning of each type of 
document which are relevant to the study. 


Procedures 


Data were collected at the specific research settings (i.e., two public and two private 
Malaysian universities) during the first academic semester of 2022/2023 which lasted for 
about seven months. In conducting the study, letters of permission were sent to the gatekeepers 
to obtain approval and permission to conduct the study. Once approval was obtained, each 
participant was given an informed consent form to indicate their agreement and willingness to 
participate in the study. Each participant was interviewed in English language for three times 
at the beginning, middle, and end of the study individually at their respective institutions. Each 
interview sessions lasted for about 60 to 80 minutes and was voiced-recorded using a voice 
recorder. All 12 interview transcripts were transcribed verbatim by the researchers for data 
analysis. 

Lesson observations were also carried out four times by the researchers at each institution. 
During the lesson observations, the researchers opted the role as non-participant observer, who 
were not involved directly or indirectly during the lesson. While conducting observations, the 
researchers documented descriptive information on what was observed, heard, and seen at the 
research sites through the researchers’ senses. This includes details about teaching and learning 
activities, reactions, interactions between ESL lecturers and their students, and the learning 
environment in the classroom. At the same time, the researchers also jotted personal reflections 
or reflective notes based on the observations, such as researchers’ experiences, thoughts, 
hunches, and personal questions that arose during the observation as part of the researcher’s 
reflexivity role. 


Data Analysis 


To analyse the data, the researchers employed six steps of thematic analysis by Braun 
and Clarke (2006). These collected data, which are in-depth interview transcripts and lesson 
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observations field notes, were then triangulated with the analysis of collected documents, 
such as the course syllabus, outlines/scheme of work, teaching schedules, and samples of 
assessments. According to Yin (2014), the procedure of triangulation helps to corroborate and 
strengthen the collected data for multiple case study approach. By using six steps in thematic 
analysis, the researchers first familiarized themselves with the data by reading and listening 
to each interview transcript for at least three to four times. This was done to help researchers 
immerse themselves into the data in trying to understand the participants’ experiences. Then, 
initial codes were generated and later grouped according to similar categories. Based on the 
categories, the researchers then developed a few possible themes, reviewed their suitability in 
answering the research question, and finally wrote up the findings. Based on the data analysis, 
six major themes emerged from the in-depth interviews to represent the problems faced by 
ESL lecturers in teaching English academic writing in Malaysian higher education institutions. 
These themes are presented in Table 2. 


Table 2 
Emerging Themes from In-Depth Interview Transcripts 


No. Emerging Themes 


Constraint of time 


Marking issues 


Students’ lack of interest and motivation 


Lack of interest in writing skills 


Lack of content and pedagogical content knowledge 


Ola; F]w]rm)])— 


Lack of institutional support 


Research Results 


Based on the findings, six themes emerged to signify the problems that Malaysian 
ESL lecturers faced in teaching English academic writing. On top of that, based on the cross- 
case analysis, ESL lecturers at public and private universities encountered different kinds of 
problems in their teaching. Figure | illustrates these differences. 


Figure 1 
Problems in Teaching English Academic Writing among ESL Lecturers in Malaysia 


Private Universities 
e Less fond of 
writing skills 


Public Universities 
e Constraint of 


time e Lack of 
. Problems 
Marking : content and 
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Problems faced by ESL Lecturers at Public Universities 


Based on the cross-case analysis, the researchers found that both ESL lecturers, Ms. Siti 
and Mr. Yash from public universities A and B encountered similar problems in their teaching of 
English academic writing. The problems that they had were constraints of time, marking issues 
and students’ lack of interest and motivation. 


Constraint of Time 


Both ESL lecturers, Ms. Siti and Mr. Yash are teaching at public universities in Malaysia. 
Both have been teaching at their institutions for nine and seven years respectively. One of 
the most prevailing problems that they faced in teaching English academic writing was the 
constraint of time. Both lamented that they did not have enough time to fully maximize their 
teaching every week. Ms. Siti mentioned that, 


“.,,among the problems that I encountered when it comes to teaching writing is time constraint. 
I dont think it is enough to see them for only 2 hours per week...” (Ms. Siti, 2™ Interview, lines 


554-555, p. 36). 


Ms. Siti disclosed clearly in her second interview that there was not enough time for 
her to teach the students for only 2 hours per week. From the analysis of the course syllabus at 
public university A, there are about 14 main topics to be covered in the span of 14 weeks in a 
semester. She claimed that it was a real struggle for her to complete the syllabus and sometimes 
she had to rush in her teaching. On top of that, Ms. Siti mentioned that some of the topics in the 
course are quite challenging and more time is needed to teach and explain, like topic on APA 
style of referencing, which can be considered as one of the technical topics in academic writing. 
Ms. Siti alluded about this by saying, 


“...like I told you, the time constraint is actually one of the factors that limiting...limiting the 
lesson itself because you have to follow the timeline and at the same time you have to get all the 
works done. So, that is when you know you don t actually have time to get things done at one time. 
Some of the contents are actually too big for them...just like the language part, they need longer 
time to explore it because they won t be able to actually understand it straightaway when we are 
explaining it...” (Ms. Siti, 3" Interview, lines 220 — 223, p. 15). 


Based on the aforementioned information, Ms. Siti claimed that 2 hours of teaching 
every week is not enough to teach English academic writing. This is due to the nature of the 
course, and there are many technical aspects that students need to learn and understand, which 
requires longer hours of lecture time. Furthermore, with a compact syllabus to be covered every 
week, she had to rush in her teaching, and this somehow or rather jeopardized her quality of 
teaching delivery. The same issue on time constraint was voiced out by Mr. Yash from public 
university B in his second interview session. He stated that, 


“\..because in 14 weeks, its like I am rushing because there are so many topics in academic 
writing. For example, in week LI, it starts with grammar topics in writing, and the topics are quite 
a lot, and it’s like I have to rush to teach all the topics...” (Mr. Yash, 2" Interview, lines 127 — 130, 


p. 9). 
Mr. Yash mentioned there were too many topics to be covered in the syllabus. Based on 


the analysis of the course syllabus of English academic writing at public university B, there 
are nine main topics with more than 30 subtopics to be covered in 14 weeks. This is quite 
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overwhelming for him as he is not only focusing on the aspects of writing skills but also on 
grammar sections, such as subject-verb agreement, tenses, reporting verbs, active passive voice 
and others. Below is a description of one of the lesson observations: 


The topic of the lesson was Clauses and Types of Sentences (grammar lesson). However, in 
that lesson, the lecturer covered four sub-topics, which are Dependent, Independent Clauses, 
Compound and Complex Sentences in the duration of 2 hours of lecture. The lesson was conducted 
in arush. The lecturer seemed to be tense while explaining to students each of the sub-topics. His 
explanation went very fast from one topic to the other, and he was reading directly from the slides 
with fewer attempts to explain and provide examples on the topics. Once he finished reading the 
slides, the lecturer then quickly asked the students to complete the exercises and gave them only 
a few minutes to complete the exercises. Once the students had completed the exercises, whole- 
class discussion was conducted to discuss the answers. This was done repeatedly in hurry for all 
four topics. A few Chinese students who were seated in the front row were caught shaking their 
heads, implying they did not manage to catch up with the lesson. Why was the lecturer rushing 
in delivering his lecture? There would be some students who did not manage to understand the 
lesson as it was very quick and fast (3"! Classroom Observation, 10" January 2023). 


Based on the lesson observation field notes, Mr. Yash was rushing to finish up the 
syllabus and he had to combine all four topics in one lesson. Students were learning in a tensed 
atmosphere where the lesson went by quickly. Moreover, Mr. Yash also told the students that 
they will be having online replacement classes during the study week to cover the unfinished 
topic, which is Reviewing and Revising Academic Writing. Thus, from this situation it clearly 
shows that Mr. Yas had constraint of time to complete the syllabus, and hence he was rushing 
during the lesson. 


Marking Issues 


The second theme that emerged from the cross-case analyses for both public universities 
is the marking issues. Both Ms. Siti and Mr. Yash claimed that they had problem in marking the 
students’ written assignments. One of the contributing factors was the huge number of students. 
At the time the study was conducted, Ms. Siti had about 60-70 students, and her class was 
conducted as a mass lecture. As a result, marking individual written assignments became one of 
the prevalent issues. Moreover, Ms. Siti mentioned that English academic writing course at her 
institution was fully graded based on coursework assessments. Hence, it added the number of 
written assignments that she had to read, mark, and grade for her class. She kept on lamenting 
how tiresome and exhausted she was when it came to grading her students’ written assignments. 


“I really love teaching writing but...the tiring part would be the marking part, I would say. You 
dislike writing because it requires a lot of attention in your time especially in marking it. The 
marking would be exhausting...”’ (Ms. Siti, 2" Interview, lines 147 — 149, p. 10). 


Though Ms. Siti admitted to loving teaching writing skills, marking and grading an 
abundance of written works was not something that she was keen on. She also lamented that it 
consumed a lot of her time. According to her, attention had to be given to the contents of writing 
and, at the same time, trying to separate and maintain her mood while grading the papers. 


“...by the time you are marking, you have to ensure there is no emotion involved so that you are 
free from bias, especially if it is a free essay. So, I think it’s a bit hard to actually cater to your 
feelings, your emotions must be neutral, you are not affected by it, you are always in good mood 
so that you enjoy the marking...” (Ms. Siti, 2" Interview, lines 612 — 615, p. 40). 
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Ms. Siti admitted that it was quite challenging when grading and evaluating her students’ 
written assignments. This was because it required a lot of time, attention, and, at the same 
time, trying to avoid bias. In parallel, Mr. Yash from public university B also encountered a 
similar problem. Compared to English academic writing course at public university A, where 
the course is fully graded based on coursework assessments, at public university B the course 
is graded based on coursework (i.e., 70 per cent) and final examination (i.e., 30 per cent). As 
a result, Mr. Yash claimed to have an abundance of markings to be done in the course and was 
having issues on the number of written works to be graded, as he had 16 contact hours per week 
with five different groups of students. He mentioned that, 


“Marking, yes...because you need to assess each of the students’ writing and it’ a lot. It is very 
tiring because you have to read one by one, check it...so, marking is very tiring...because there 
are lots of assignments plus the final exam...”’ (Mr. Yash, 3" Interview, lines 355 — 356, p. 24). 


Based on his statement, he admitted that marking students’ written assignments was 
very exhausting for him, considering that all the assignments were individual assignments. 
Moreover, he also had to evaluate and mark students’ final examination answer scripts. With 
that, he further confessed that marking was a tedious task as he had to pay attention to each 
student’s writing in terms of their contents and arguments while grading their piece of writing. 


Students’ Lack of Interest and Motivation 


The third theme developed from the cross-case analyses at public universities is the 
theme of students’ lack of interest and motivation. Both public university ESL lecturers, Ms. 
Siti and Mr. Yash claimed that most of their undergraduate students lacked the interest and 
motivation to learn English academic writing. These ESL lecturers claimed that most of their 
students did not view English academic writing as an important course in their studies, even 
though it is one of the university's compulsory courses. In Ms. Siti’s case, she was teaching 
non-language students (i.e., Administration and Science Policy students) and according to her, 
most of the students did not perceive skills in academic writing as important skills. She kept 
on telling the researchers during her interview session that it was quite challenging for her to 
convince the students that those skills in academic writing are fundamental and pivotal for their 
undergraduate studies, especially when they had to prepare their final year project paper (FYP) 
in their final year of undergraduate study. She expressed her concerns by saying, 


“\..and the fact that for some students, they see English as their elective course because they are 
not basically, taking TESL or English programs. So, they, probably they did not see this subject 
as important as their core subject, this is their elective subject. I think that would be one of the 
problems that I faced when it comes to my teaching...” (Ms. Siti, 2" Interview, lines 557 — 560, 


p. 36). 


Based on Ms. Siti’s observations on her students, she claimed that some of them did 
not see the importance of learning English academic writing. They see academic writing 
course as another English course that they need to register as part of the requirements for their 
undergraduate study. Therefore, she said that it was quite challenging to make her students ‘see’ 
the relevance and importance of learning and acquiring skills in academic writing. 

A similar problem was faced by Mr. Yash in his teaching at public university B. He 
was also teaching non-language students from different faculties, namely from Faculty of 
Engineering, Faculty of Medicine, Faculty of Arts and Design, Faculty of Agriculture and 
Faculty of Educational Studies. According to him, the differences in students’ educational 
backgrounds (majors) play an important part in terms of how he deals with their interests, 


https://doi.org/10.33225/pec/24.82.434 ISSN 1822-7864 (Print) ISSN 2538-7111 (Online) 


Khairunnisa AZMAR, Abu Bakar RAZALI. Problems in teaching English academic writing among ESL lecturers at public and private 
universities in Malaysia 


and motivations in learning English academic writing. He added that these students do not see 
academic writing as an important skill and significant as they perceived English course as an 
elective and not as their main core course. He further reiterated this is the same problem that he 
encountered every semester. 


“Yes, they have to take it. Medic program, they dont have FYP, but they need to take academic 
writing course... another one is School of Economics, they also dont have FYP, but the students 
need to take academic writing course. So, students have the perception like “why [do] I need to 
learn English academic writing when I dont have to write FYP?” Like this semester I’m teaching 
the architecture and design students. The class is on Monday evening from 5.00 p.m. to 7.00 p.m. 
and they have the perception like “why I need to learn this...”’ (Mr. Yash, 3" Interview, lines 328 — 
334, p. 22). 


Based on this excerpt, it was challenging for Mr. Yash to change his students’ negative 
perceptions towards English academic writing. He confessed that he had to work hard to get 
their attention and tackle their interests by bringing them closer to the lesson on the importance 
of academic writing for their study and as a lifelong skill. He mentioned that, 


“that is the challenge for me to twist the perception that students have towards academic writing 
course. I really need to learn to tackle them. I always say to them, “if you understood what I am 
teaching you, at least you could teach your siblings and later your own kids”. They need to have 
positive thinking towards academic writing. Yes, it is a challenge for me especially to motivate 
them and I think I have talked about this in terms of the challenges that I faced when teaching this 
course...” (Mr. Yash, 3" Interview, lines 331 — 347, p. 23). 


He further stated that it was not easy for him to cope with the student’s lack of interest 
and motivation since they had the idea they did not need to produce their FYP. Moreover, some 
of these classes were held late in the evening, from 5.00 p.m. until 7.00 p.m., which was not 
quite suitable for undergraduate students as they could no longer sustain their attention and 
motivation during this hour. In all, both ESL lecturers from public universities encountered 
problems, such as constraints in time, marking issues, and dealing with students’ lack of interest 
and motivation in teaching English academic writing to their undergraduate students. 


Problems faced by ESL Lecturers at Private Universities 


Findings from the cross-case analyses between the two private universities A and B 
revealed that ESL lecturers, Mr. Ray, and Ms. Ana faced different kinds of problems in their 
teaching. The emerged themes are Jack of interest in writing skills, lack of content knowledge 
and pedagogical content knowledge, and lack of institutional support. 


Lack of Interest in Writing Skills 


One of the intriguing findings that the researchers found from the analysis was the lack 
of interest in writing skills in Mr. Ray. He made it clear in all the interview sessions (1.e., three 
times) that he was not keen on writing skills, and it became one of the challenges for him when 
he had to teach an academic writing course. He confessed this by saying, 


“I am not really a fan of writing skills. Though I am teaching academic writing, I dont like 
teaching writing skills. So, that becomes a challenge for me because you don t like it but you...you 
know...in the classroom you have to fake it to make it...” (Mr. Ray, 3 Interview, lines 62 — 64, 


p. 5). 
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Based on his admission, it was clear that writing skills are not his forte. The researchers 
realized that this was due to his prolonged issues and negative perceptions towards writing 
as a technical and demanding skill since he was still a student. Mr. Ray recalled his learning 
experience where he learned writing mostly through traditional approach where learning was 
very passive with fewer interactions between the lecturer and students. He further shared the 
difficulties he had encountered in writing, such as difficulties in planning his writing and other 
language problems, such as lack of reading habits, vocabulary, and mechanics of writing. 
Those negative perceptions have not changed since then. Moreover, he also admitted preferring 
teaching other language skills, such as listening and speaking. To him, these two language skills 
are less technical compared to writing skills. 


“I kind of like to have listening and speaking because you can do a lot more activities with that 
and you can really get them to move and walk around...listening you can have songs and then for 
the speaking activity, follow-up you can like “tell me what do you feel about that songs” ...you 
know ...just them giving the responses...you know...its just listening and speaking and if to go 
through a rank, I would say that, it’s going to be listening, speaking, reading and writing. Writing 
is the least preferred subject to teach...” (Mr. Ray, 2™ Interview, lines 116-121, p. 8). 


Based on the above excerpt, Mr. Ray affirmed in his second interview that he was not 
keen on teaching writing skills, and it is the least preferred skill to teach. To him, listening and 
speaking skills lessons are much more enjoyable as they involve a lot of movements, and many 
interesting activities can be done with the students in the classroom that do not require lots of 
technical aspects, unlike academic writing. In short, Mr. Ray from private university A lacks 
interest in teaching writing skills, and that has become one of the prevalent issues when he must 
teach academic writing. 


Lack of Content Knowledge and Pedagogical Content Knowledge 


Meanwhile, the researchers found that Ms. Ana from private university B had different 
problems. She was found to lack content knowledge and pedagogical content knowledge 
in teaching English academic writing. As a result, she encountered a few difficulties in her 
teaching, such as preparing teaching materials, determining the suitability of the materials, and 
delivering the lesson itself. She admitted, 


“\..when I first prepared the materials, it was difficult for me because I wasnt so sure how it 
should be done in terms of essay. Okay, Classification essay but what are the things that I must 
focus on? If it’s the introduction, how do I teach the introduction to the students? I was not able 
to pick up the skills at the time when I looked at the Course Outline. So, that was difficult for me 
during my first semester. I struggled because I felt is this too much or this is too little. Do I need 
to add more? Do I need to remain as it is? So, it was difficult for me in terms of the pedagogy 
especially APA citation as well because I was exposed to APA citation but not the latest version, 
so in which I have to re-study again and I have to ensure that everything is in place...” (Ms. Ana, 
2" Interview, lines 285 — 292, p. 19-20). 


Based on this revelation, Ms. Ana admitted that it was challenging for her not only in 
terms of teaching the course but also in terms of preparing the lesson materials. She lacked 
content knowledge in preparing the lesson materials, especially in determining the levels of 
difficulty of the lesson materials to suit the levels of her students’ English language proficiency. 
Therefore, she was quite unsure when preparing the lesson materials. She said that, 


https://doi.org/10.33225/pec/24.82.434 ISSN 1822-7864 (Print) ISSN 2538-7111 (Online) 


Khairunnisa AZMAR, Abu Bakar RAZALI. Problems in teaching English academic writing among ESL lecturers at public and private 
universities in Malaysia 


“It was my first time teaching the subject in which I did not expect to get [to teach] writing. I 
was expecting a course that is more towards speaking, that is what I was expected. Yaa...that is 
one of the root causes and another thing is because maybe I have lack of preparation. I wasn t so 
sure, like I have mentioned earlier, I wasnt so sure if this is the right thing to do. I also did not 
approach...people who I should approach in this matter which are...the subject matter expert. 
So, those are my main problems that I faced when I first started teaching writing for academic 
purposes...” (Ms. Ana, 2™ Interview, lines 305 — 311, p. 20-21). 


Ms. Ana admitted that it was her first time teaching an academic writing course, and she 
was not prepared to be given such a demanding and technical course to teach when she first 
started her teaching career at private university B. With her lack of teaching experience at the 
tertiary level (i.e., 2 years), the researchers concluded that one of the problems that she faced 
as a young ESL lecturer was her lack of content knowledge in English academic writing and 
pedagogical content knowledge to teach the course. When asked about areas of improvement 
in her teaching, Ms. Ana admitted that she needs to better equip herself with more content 
knowledge as she said, 


“It would be content knowledge. I think I can improve better if there are a lot of readings, a lot of 
tutorials ...different kinds of tutorials I can provide to the student. In terms of content definitely, 
because I think it is very important for us to keep on renewing the knowledge in ourselves so that 
we have an idea what to improve on...” (Ms. Ana, 3" Interview, lines 86 — 89, p. 6). 


With such revelation, this shows that Ms. Ana admitted she lacked content knowledge 
and would like to improve more in that area. Despite that, she still tried her best to deliver 
quality lessons to her students. 


Lack of Institutional Support 


The second theme to define the problem faced by ESL lecturers from private universities 
is the lack of institutional support. Ms. Ana from private university B encountered this problem 
as she confessed there was lack of professional support given by her institution in terms of a 
shortage of training/seminars/workshops for academicians. She acknowledged this by saying, 


“Specifically for Writing for Academic Purposes that I am currently teaching, we don t have that, 
but we do have trainings where it is on general trainings like... how to use technology for example 
VLE system (i.e., university system)...but pedagogy, I have yet to attend one...” (Ms. Ana, 3” 
Interview, lines 125 — 127, p. 9). 


As someone who is a novice to tertiary education, institutional supports are needed by 
Ms. Ana. She further mentioned that it would be good if she could attend those seminars/ 
trainings/workshops on pedagogy so that she can learn and improve her teaching for the benefit 
of her students and also her teaching career. 


“Yes, it’s definitely important because it can add up values and knowledge for us to vary with our 
teaching methods. Because when we go for trainings, we will be equipped with new knowledge 
that we may have not heard before or tried before, so I guess it’s very useful especially for a fresh 
graduate like me because I’m still new in teaching at tertiary level, 2 years. So, I think in terms 
of pedagogy knowledge, there are a lot of things to be improved and there are many things that I 
need to work on because whenever I ask for feedback, I feel like my colleagues have been doing a 
good job and I feel like I have a lot to catch up. I’m not saying it’s not good but there are a lot of 
improvements to be done...” (Ms. Ana, 3" Interview, lines 142 — 147, p. 10). 
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Ms. Ana acknowledged the need for seminars/trainings for fresh graduates like her to 
develop their teaching careers. With such an opportunity, she could improve her pedagogy as 
well as her content knowledge in English academic writing. In short, the kinds of problems 
that Ms. Ana had in teaching English academic writing were lack of content and pedagogical 
content knowledge as well as lack of institutional support. Meanwhile, Mr. Ray from private 
university A had an issue with his lack of preference towards writing skills. 


Discussion 


Findings of this multiple case study reveal that teaching English academic writing is a 
daunting task for most ESL lecturers both in public and private universities, and they suffer 
from different kinds of problems. This is because ESL lecturers are not only dealing with the 
nature and technical aspects of academic writing itself, but also must deal with other problems 
in their teaching within their own institutional contexts. One of the most prevalent problems 
indicated by the study’s findings is the lack of content knowledge and pedagogical content 
knowledge of ESL lecturers, especially those with less than 5 years of teaching experience. 
With such inadequacy, this is worrying as skills in academic writing are important and essential 
for students at tertiary level as it is the medium of communication in academe. 

Apart from the lack of content knowledge, the issue on lack of pedagogical skills also 
needs to be highlighted. Some ESL lecturers, especially those in private universities are not 
well equipped with pedagogical knowledge and skills to teach academic writing. As a result, 
they are not aware of matters pertaining to the selection of teaching materials, preparing lesson 
materials that meet the students’ needs and course learning outcomes, and varying their lesson 
materials according to levels of difficulty based on students’ proficiency levels. It is imperative 
for ESL lecturers to have both knowledge of content and pedagogy to teach English academic 
writing. This problem is more prominent among ESL lecturers in private universities as they do 
not have a clear guide/textbook in teaching academic writing. As a result, these ESL lecturers 
have to search for and prepare their own teaching materials to be used in the classroom, and 
as described earlier, some of them lack teaching experience in tertiary context and preparing 
lesson materials is one of the challenges. With unclear guidance of lesson materials, these 
ESL lecturers struggle to teach academic writing as they are unaware of how ‘to approach’ 
the course in providing meaningful lessons to their students. Unlike ESL lecturers who are 
teaching at public universities, they are provided with standardized lesson materials, such 
as academic writing textbooks and lecture notes, which are used by both ESL lecturers and 
students. Teaching becomes much easier for these lecturers as they have a guide to teach the 
students, and moreover, they do not face the struggle in preparing their own lesson materials. 
Therefore, the researchers believe that the same guidelines to teach academic writing should be 
provided to ESL lecturers at private universities. 

The discussion of pedagogical skills among lecturers in teaching academic writing is 
also one of the issues highlighted by Mahmood (2020). In his mixed methods study in Pakistan, 
he acknowledged that the selection of lecturers to teach English academic writing does not 
receive greater emphasis. He found that there were no specific pedagogical skills, teaching 
certifications, writing skills, or assessments used to measure the lecturers’ competency to teach 
English academic writing. This is worrying as the shortage of knowledge, skills and training 
among ESL lecturers are some of the factors that impact their teaching, as mentioned by Hadi 
et al. (2021). The same issue is highlighted in a much more recent study by Abdulkhalek and 
Al-Khulaidi (2022) that among the issues in teaching academic writing is unqualified writing 
lecturers who do not possess the needed content knowledge and teaching experience at tertiary 
level. In relation to this issue, the researchers urged higher institutions to pay more attention to 
the selection of their academicians and provide necessary professional support to help improve 
their academicians’ pedagogical skills. 
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Another significant finding of the study is marking issues, especially for lecturers who 
are teaching in public universities, where they usually teach many classes, and each class would 
consist of up to 70 students. To the researcher’s knowledge, not many previous studies have 
indicated similar issues in regard to problems faced by ESL lecturers, especially in Malaysian 
tertiary context. Marking and grading are never-ending issues and, in fact, are synonyms for 
writing skills. Based on the interview sessions with the ESL lecturers (i.e., from both public 
and private universities), they admitted to disliking marking activities. Some of them confided 
that it took them a lot of time to read, evaluate, and understand the students’ written works, and 
some of these ESL lecturers confessed to not prefer reading and marking, especially when they 
have many students, and they need to spend longer time in marking. Moreover, it becomes a 
burden to ESL lecturers when they are given a huge number of students in a class, and this could 
be too overwhelming considering the technical aspects that need to be paid attention to when 
marking written assessments. This is the case when Li and Ma (2020) pointed out in their study 
that one of the problems faced by ESL lecturers is the issue of class size. To help overcome 
marking issues due to large class sizes, the researchers propose ESL lecturers consider adopting 
a collaborative writing approach where students can learn to write in pairs or in groups. In this 
way, it can help to reduce the burden in marking written assessments. 

On top of that, the findings also reveal that personal preference towards writing skills 
is also one of the issues that needs to be highlighted. All the ESL lecturers who participated 
in the study acknowledged that they preferred to teach other language skills than writing. This 
somehow signifies the daunting and demanding aspects of writing skills compared to other 
language skills that make ESL lecturers feel reluctant to teach the skill. This is prevalent among 
ESL lecturers especially those who graduated in other fields than Teaching English as a Second 
Language (TESL). With no background in ESL education, these lecturers may lack pedagogical 
content knowledge to teach as they are not equipped with knowledge on pedagogical courses 
while pursuing their undergraduate and postgraduate levels (Master's degree). With such 
inadequacy, these lecturers had issues in their teaching which is much prevalent among those 
who are teaching at private universities. These ESL lecturers may not be ready in terms of 
their knowledge and pedagogical skills to teach academic writing, considering their educational 
background and less teaching experience at tertiary level. Proper measures should be taken 
to mitigate these problems or else students’ learning will be at stake, and this should not be 
compromised. 


Conclusions and Implications 


The findings of the study indicate that ESL lecturers in Malaysian tertiary context, both 
in the public and private universities, do encounter several problems in their teaching of English 
academic writing which are constraints of time, marking issues, students’ lack of interest and 
motivations, lecturers’ lack of interest in writing skills, lack of content and pedagogical content 
knowledge, and lack of institutional supports. This is no doubt, as academic writing is a technical 
skill and encompasses many facets in which teaching this skill has been demanding among 
ESL lecturers. To alleviate some of the problems and concerns in teaching English academic 
writing, professional support from higher education institutions is much needed for these 
lecturers depending on the context of the teaching. On one hand, while there is a clear guide to 
the teaching of English academic writing course in Malaysian public universities through the 
use of conventional academic writing module, the lack of time allocated for teaching academic 
writing (only 2 hours every week) and the huge number of students in the class are really 
putting a lot of strain on the ESL lecturers to complete and finish the module and especially in 
marking their students’ written works. 
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Onthe other hand, while there is more freedom from ESL lecturers from private universities 
in teaching their students academic writing due to the lack of clear academic writing module and 
they can rely on more varies sources of teaching materials, these ESL lecturers do lament on the 
lack of guide and support that are not given to them by their universities. Furthermore, lecturers 
from both universities do also lament on the lack of continuous professional development 
and support from their respective institutions for them. The researchers believe that this is an 
important aspect that should be focused on by both public and private universities in addressing 
this issue. This can be done by continuously providing the needed seminars/trainings/workshops 
conducted by experts from the field of English for academic purposes (EAP) to share the current 
issues and techniques to teach academic writing. Moreover, mentorship in terms of preparing 
lesson materials and knowledge on content and pedagogical skills can be shared between senior 
and junior ESL lecturers and should be implemented in the institutions to help alleviate some of 
the teaching problems faced by young junior ESL lecturers. 

Additionally, policymakers, curriculum developers and subject matter experts need 
to revisit and relook at the syllabus of English academic writing course for both public and 
private universities. Changes and modifications to the syllabus, especially on the contents and 
assessments, are needed so that it does not only meet and achieve the course learning outcome 
but also helps to improve students’ learning and helps to bridge the practice gaps. For one, the 
large size of classes in public universities should be made smaller so that more meaningful 
academic writing lessons can take place. On another note, more support on the teaching 
materials and teaching aids, especially in private universities, should be focused as well by 
the administration in private universities so that ESL lecturers can feel more supported in their 
teaching. Furthermore, ESL lecturers in both public and private university settings should not 
be burdened with overloaded content and overwhelmed with the assessments in the syllabus. 
The authors suggested ESL lecturers employ process and collaborative teaching approaches 
where students can learn to write according to the process of writing collaboratively with one 
another. This will not only help to reduce the burdens faced when marking assignments in 
academic writing course as students co-authored in the writing process and at the same time 
exposed to the correct methods of producing writing. 

Henceforth, the findings from this study are highly beneficial to ESL/EFL lecturers, 
students at the tertiary level (i.e., undergraduate and postgraduate), higher education institutions, 
and policy and curriculum makers both at local and international contexts in exploring the kinds 
of problems in teaching English academic writing. A review of past literature has shown there 
is a scant of studies conducted where qualitative study design is used to explore in-depth the 
issues of teaching English academic writing. Through this research, the authors managed to 
explore the breadth and depth of teaching problems faced by ESL lecturers in the real-life 
context of the phenomenon by making a comparison between public and private universities. 
Therefore, it is imperative to further explore this area as the skills in academic writing are 
significant and important in both local and global contexts, as writing is a lifelong skill and 
the main source of communication in tertiary education. Findings from this study are hoped 
to help shed some light on ESL lecturers and related stakeholders to take necessary measures, 
especially in providing content and pedagogical knowledge and professional support to 
overcome the problems in teaching English academic writing. Through these supports, ESL 
lecturers can enhance their knowledge and skills in teaching academic writing and help their 
students improve their academic writing skills. 


Limitations 


There are a few limitations of the study especially in terms of the methodology used. The 
conducted study was done using a qualitative multiple case study approach where findings from 
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the small sample size of the study are unable to be generalized to the whole population of all 
ESL lecturers who are teaching at higher education institutions, be it in Malaysia or elsewhere. 
Moreover, the study only focuses on ESL lecturers who are teaching English academic writing 
to undergraduate students at public and private universities in Malaysia. Findings from these 
institutions may not be inclusive to other ESL lecturers who are teaching English academic 
writing at other types of higher education institutions, such as colleges, college universities, 
and polytechnics in Malaysia or outside of Malaysia. Findings from these institutions may 
produce different kinds of findings due to different factors, such as syllabi of English academic 
course, teaching workload, teaching materials, ESL lecturers’ experience, and their content and 
pedagogical knowledge. 


Recommendations 


The researchers call for more studies that focus on the problems faced by ESL lecturers 
in teaching English academic writing to postgraduate students. Other than that, future studies 
should also be conducted at other types of institutions, such as colleges, college universities, 
and polytechnics. This will provide more interesting findings on the issues circling the teaching 
of English academic writing. Lastly, future research could also be done to explore the strategies 
employed by ESL lecturers to overcome the problems they faced in teaching English academic 
writing. 
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Appendices 


Appendix A: Semi-structured In-depth Interview Questions 

First Interview (beginning of the study) 

A) General questions on personal and professional background 

1. Please tell me about yourself, your educational background, and your professional 
background as an ESL lecturer. 

2. How and why did you become an ESL lecturer? 
- How many years of teaching experience do you have, specifically at the tertiary level? 
- When did you start teaching at the tertiary level? 
- What are some of the English language courses you have taught so far? 
- What criteria do you think qualify a person to become a university lecturer? 


Second Interview (middle of study) 

B) ESL Lecturers’ experience in teaching writing at the tertiary level 

1. Please tell me about your teaching load, the course(s) you are currently teaching and 
for which program (e.g., engineering, business, accounting etc.) 

2. What would be your usual teaching routine as an ESL lecturer the moment you enter 
the classroom? 

3. When did you start teaching writing course? 
- Is it at the beginning of your career or just recently? 
- What is the name of the writing course(s) you have taught and how was your 

teaching experience? 

- Among the four language skills, which one do you prefer or like to teach and why? 
- What about writing? You don’t like to teach writing skills? 
- How do you think writing should be taught in the classroom? 


Third Interview (end of study) 
C) Problems faced by ESL lecturers in teaching academic writing 
1. What are the problems that you encounter when teaching writing? 
- What do you think is the root cause of the problems you mentioned? 
- How did you resolve the problems or situations that you mentioned? 
- In which way do you think teaching writing at the tertiary level is different from that at the school 
level? 
- In your own view, do you think teaching writing is challenging as compared to other language 
skills? Why is that? 
- Have you ever felt tired of teaching writing? 


Appendix B — Sample of Lesson Observation Field Notes 
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Abstract 


Developing effective oral business English (OBE) curricula requires clearly understanding student needs. 
This study evaluated the speaking needs of Chinese English as a Foreign Language (EFL) undergraduates 
majoring in business English for specific purposes (ESP), aiming to inform the design of a teaching 
module that bridges the gap between current speaking abilities and the escalating demand for advanced 
communication skills in business contexts. A needs analysis questionnaire, reflecting the first phase of 
the ADDIE model (analysis, design, development, implementation, evaluation), was administered to 398 
randomly selected participants using a quantitative, cross-sectional survey design. Results revealed that 
while students struggle with speaking errors and lack communication confidence, they favor interactive 
activities such as presentations, discussions, and role-plays. Concerns about current OBE pedagogy and 
materials highlight a need for more collaborative learning and teacher support. Statistical analysis using 
independent-samples t-test and one-way ANOVA showed no significant differences in speaking needs 
based on gender, age, years of English study, or English proficiency. However, a significant difference 
was reported between fourth-year and third-year students. This study offers some insights for developing 
more effective interventions to address the specific needs of Chinese business English undergraduates in 
Chinese ESP education. 

Keywords: ADDIE model, Chinese EFL learners, module development, needs analysis, oral business 
English, ESP 


Introduction 


Against the backdrop of deepening globalization in multinational business cooperation 
and cross-cultural communication, nurturing compound talents is an urge requested by China’s 
government to consolidate the positive profile for its international presence. In fulfilling the 
growing needs of the existing market and employment demand, an interdisciplinary subject 
named business English, combining linguistic knowledge and knowledge of business has 
been established in Chinese higher learning over a decade. Business English prioritizes the 
significance of speaking competencies in business trades (Guo, 2022). Therefore, oral business 
English (OBE) is one of the core courses learned by Chinese EFL undergraduates in business 
English, which grants them with practicability and boosts their job competitiveness in the 
future. Unfortunately, the intended outcomes and effects of business English teaching have 
remained at an unsatisfactory level to some extent in recent years since most of them are not 
adept at performing well in speaking activities in the given business scenarios, as well as the 
teacher-dominated teaching method is no longer suitable for current teaching needs. Despite 
various pedagogical reforms bringing changes to the teaching of business English in general 
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and OBE in particular, universities in China's coastal region have consistently made focused 
efforts to enhance the quality of business English instruction (e.g., Li, 2020; Lu & Zhu, 2019; 
Zhu, 2020). On the other hand, universities from inland areas are commonly neglected when 
conducting related studies in language education (Guo, 2022). Therefore, expanding OBE 
reforms, and incorporating stakeholder perspectives from inland regions is crucial and an 
evolving evaluation of university business English programs is also needed. 


Literature Review 
English Proficiency Among EFL Learners 


Speaking proficiency is an essential part of mastering any language to help language 
learners express their feelings, knowledge, and thoughts (Sha’ar & Boonsuk, 2021). Teaching 
speaking should aim at improving learners’ communicative competence to raise appropriate 
responses to the different contexts they are involved in (Alghamdi et al., 2019, Nhi & AlSaqqaf, 
2023). However, improving speaking proficiency is relatively neglected in the contexts of 
English as a foreign language (EFL) (Alghamdi et al., 2019). EFL language learners worldwide 
face challenges in acquiring productive speaking skills. Despite having foundational linguistic 
knowledge, many Chinese EFL students struggle with basic speaking tasks and experience 
communication barriers (Cui, 2013; Wang, 2002). Similarly, AlSaqqaf et al. (2023) and Guo 
(2022) found that Chinese EFL learners often feel dissatisfied with their pronunciation and 
intonation. This dissatisfaction can lead to a loss of motivation and hinder language acquisition. 
Studies from other countries also highlight the challenges of acquiring productive speaking 
skills. Hamad (2013) found that Saudi Arabian students' limited English proficiency and use of 
Arabic in the classroom impede their ability to communicate effectively in English. Sha'ar and 
Boonsuk (2021) identified poor pronunciation and insufficient vocabulary as factors contributing 
to speaking anxiety among Thai university students. Thus, overcoming communication barriers 
becomes crucial in effective language acquisition. 


Business English in China 


Business English is an essential discipline in applied linguistics that teaches English to 
fulfil the specific needs of students majoring in business professions. It has been established 
as an independent discipline in China since 2007, and over 400 universities and colleges offer 
the major (Liu, 2015; Wang & Ai, 2019; Zhu, 2020). According to the Teaching Guide for 
Undergraduate English Major issued by the Ministry of Education in 2019, business English 
majors should be familiar with English literature, economics, management, law, and other 
related theoretical knowledge. They should also possess strong intercultural skills, business 
communication skills, and innovative and entrepreneurial abilities. However, previous studies 
have found that business English teaching in China needs to be updated to accommodate the 
current needs of students. This includes using authentic materials for ELT, practicing skills in 
real scenarios, and setting business English apart from teaching English for general purposes 
(EGP) (Lu & Zhu, 2019; Wang & Ai, 2019; Wu, 2019; Zhu, 2020). In a nutshell, reviewing 
the current status of China’s English language education in this part is to urge for a change in 
ELT, especially to evaluate the needs of students majoring in such an interdisciplinary subject 
from time to time, to better explore the practices of English language education, and to keep the 
teaching and learning up to date since everything exists in dynamic ways. 


Theoretical Framework of Needs Analysis 


ISSN 1822-7864 (Print) ISSN 2538-7111 (Online) https://doi.org/10.33225/pec/24.82.456 


PROBLEMS 
OF EDUCATION 


IN THE 21*CENTURY 
Vol. 82, No. 4, 2024 


PROBLEMS 
OF EDUCATION 


IN THE 21* CENTURY 
Vol. 82, No. 4, 2024 


458 


Ke HU, Asmaa AISAQQAF. Needs analysis for designing and developing an EFL teaching-speaking module for the unique linguistic 
tapestry of Chinese business English undergraduates 


Needs analysis is a crucial step in developing effective ESP curricula as it helps 
identify any discrepancies between learners' current skills and their desired future outcomes. 
According to Richards (2001), needs analysis is widely recognized as a crucial starting point 
for curriculum development. This process involves identifying both target needs (what learners 
need to be able to do in the target situation) and learning needs (what learners need to learn) 
(Hutchinson & Waters, 1987). Target needs can be further classified into necessities (required 
language abilities), lacks (areas where learners are lacking), and wants (learners' expectations) 
(Hutchinson & Waters, 1987). Learning needs, on the other hand, explore learners' motivations 
and reasons for language learning. Various techniques, including questionnaires, interviews, 
meetings, and case studies, can be employed to gather data for needs analysis (Richards, 2001). 
Therefore, understanding the specific needs of Chinese EFL undergraduates in OBE is essential 
for designing effective speaking proficiency improvement programs. This study adapted the 
theoretical framework of Hutchinson and Waters (1987), focusing on both target and learning 
needs within the context of OBE. 

The existing research on business English teaching in China highlights several outcomes. 
Dai and Liu (2016) found that Chinese business English learners advocated for their teachers to 
adopt updated pedagogical approaches that foster a positive teacher-student relationship. Guo 
(2022) identified student dissatisfaction with their speaking proficiency, and independent learning 
abilities, noting a lack of suitable materials and effective classroom instruction for developing 
speaking skills in business contexts. Hu and AlSaqqaf (2023) validated a needs analysis scale 
for Chinese business English teachers, including three constructs with 17 measuring items 
for OBE teaching. Research from international contexts also emphasizes the importance of 
communicative activities and collaborative learning in ESP courses. Iswati and Hastuti (2022) 
reported that Indonesian business English students held a moderately positive attitude towards 
their teachers, materials and courses, suggesting improvements such as diversifying learning 
activities and incorporating appropriate language skills into teaching materials. Similarly, 
according to the findings of Suraprajit et al. (2024), Thai university students specializing in ESP 
within the logistics field also expressed a strong desire to improve their English proficiency. 
The study underscored that speaking posed the most significant challenge for these students, 
compared to other English language skills. 


Research Problem 


Given the context of China's global economic presence, effective business English 
teaching is crucial for equipping students with the communication skills needed for professional 
success. However, a significant gap exists in developing OBE curricula for Chinese business 
English undergraduates. While research highlights the significance of student-centered learning 
and the crucial role of speaking skills, few studies have explored how demographic factors 
might influence specific learner needs. This lack of empirical data hinders the development 
of curricula that adequately address the unique speaking demands of this student population. 
This study aimed to bridge this gap by examining Chinese business undergraduates’ specific 
speaking needs (target and learning), providing insights to inform the design of more effective 
teaching modules and materials. 


Research Aim and Questions 
The oversights identified in the literature review above highlight the need for a more 


comprehensive understanding of the speaking needs of business English undergraduates at 
Chinese universities. Accordingly, this study aims to identify the specific needs required for 
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designing and developing an effective EFL teaching-speaking module tailored to Chinese 
ESP teaching at the higher education level. Moreover, the study attempts to find out whether 
demographic variables affect the determination of students’ needs. Therefore, the study 
addresses two key research questions (RQs) as follows: 


RQI: What are the needs required for designing and developing an EFL teaching-speaking 
module from the perspective of business English undergraduates at Chinese universities? 

RQ2: Is there any significant difference in the EFL speaking needs of Chinese business 
English undergraduates based on their demographic variables (gender, age, levels of study, the 
years of studying English, and levels of English proficiency)? 


Research Methodology 
General Background 


Quality education, a key United Nations Sustainable Development Goal (UN-SDG), 
necessitates ongoing needs analyses to adapt curricula to the evolving career market. This is 
particularly relevant for undergraduate business English programs, which aim to equip graduates 
with the language skills necessary for success in the globalized business environment. In China, 
where the economic landscape is rapidly changing and the demand for skilled English-speaking 
talents is increasing, ensuring the relevance of business English programs is crucial. Therefore, 
this needs analysis was conducted in early 2023. 


Research Design 


This study adopted a positivist paradigm, employing a quantitative research approach 
and a cross-sectional survey design. A needs analysis questionnaire was used to collect data 
on the perceptions of Chinese EFL undergraduates regarding business English, focusing on 
the "analysis" phase of the ADDIE model (analysis, design, development, implementation, and 
evaluation). This structured approach generated data-driven insights into the specific needs of 
Chinese business English undergraduates concerning OBE. 


Sampling Selection 


This study employed a simple random sampling method to select 398 business English 
undergraduates from China. The sample size was determined using Krejcie and Morgan's 
(1970) sampling table to ensure equal representation and minimize sampling error (Creswell, 
2014). Before data collection, participants were fully informed of the ethical considerations 
for this study, adhering to established guidelines (McMillan, 2012) regarding the aim of the 
study, confidentiality and anonymity. The study sample is predominantly female (91.5%), with 
a smaller proportion of males (8.5%). The majority (36.2%) fall within the 19-20 year-old age 
group, with representation across all ages from 18 years old and below to 23 years old and 
above. Many participants (51.5%) are in their second year of study, with smaller proportions 
in their fourth year (28.1%), third year (19.8%), and a minimal representation in the first year 
(0.5%). The years of English study for the respondents range from 1-5 years (9.5%), 6-10 
years (44.2%), and 11-15 years (42.7%). A small percentage (3.5%) have been studying for 
16 years or longer. In terms of English proficiency, the majority fall into the intermediate 
level (lower) (35.4%), followed by the basic level (upper) (32.7%), and the intermediate level 
(lower) (12.1%). The advanced and basic (lower) levels represent 5.1% and 1.3% of the sample, 
respectively. 


Instrument and Data Collection Procedures 
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To collect data for the study, a closed-ended questionnaire utilizing a 5-point Likert 
scale was used. The items in the questionnaire addressed the target needs analysis and learning 
needs of the respondents (Hutchinson & Waters, 1987). The questionnaire consisted of 26 items 
organized into five constructs based on the theoretical framework. These constructs included 
target needs, encompassing speaking difficulties (9 items), required speaking activities (4 items), 
and learning styles (6 items) (see Tables 2, 3, and 4). Additionally, the questionnaire addressed 
learning needs, exploring perceptions of the course (4 items) and the use of instructional 
materials (3 items) (see Tables 5 and 6). This framework was informed by existing research on 
needs analysis in language learning (Dai & Liu, 2016; Gravatt et al., 1997; Menggo et al., 2019; 
Yanna, 2016). To mitigate language barriers, the questionnaire was translated into Chinese by 
two certified translators and back-translated into English (Dérnyei & Dewaele, 2023). Prior to 
data collection, the questionnaire underwent validation and reliability testing. Content validity 
was assessed by three experts with PhDs in relevant fields, while face validity was evaluated 
by five students. A pilot test with 52 students, similar to the target participants, was conducted 
using Microsoft Forms to assess reliability. Cronbach's alpha yielded a reliability coefficient 
of 0.812, indicating acceptable internal consistency (Taber, 2018). For actual data collection, a 
Microsoft Forms questionnaire was randomly distributed to business English undergraduates at 
Chinese universities. Data collection spanned five weeks, resulting in responses from 398 EFL 
undergraduates majoring in business English. 


Data Analysis 


The collected data were processed using SPSS 29.0 to analyze the quantitative data 
obtained in this study. To address the RQs posed in this study, specific data analyses were 
employed. Descriptive analysis was used to analyze RQ1. RQ2 was addressed using inferential 
analysis, including both the independent-samples t-test and one-way ANOVA for comparative 
analysis. 


Research Results 
Descriptive Results 


A descriptive analysis of 26 items was conducted to address RQ1. A 5-point Likert scale 
was used for data collection, with responses ranging from | to 5. For Tables 1 and 2, the scale 
represented frequency, with | indicating never, 2 hardly, 3 sometimes, 4 often, and 5 always. 
Regarding Tables 3-5, however, the scale represented agreement, with | indicating strongly 
disagree and 5 strongly agree. The presentation of results included frequency (%), mean (M), 
and standard deviation (SD) values. Normality testing was performed using skewness (-1.96<- 
.125<1.96) and kurtosis (-1.96<.640<1.96) values (Ghasemi & Zahediasl, 2012). The reliability 
of the constructs achieved an overall Cronbach's alpha value of .864, exceeding the acceptable 
threshold of .70. 


Table 1 
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Target Needs for Student Use (Speaking Difficulties) 461 
No. Speaking Difficulties (N = 398) 1 (%) 2 (%) 3 (%) 4(%)  5(%) M(SD) 
1 | have difficulty working in small groups 10.8 37.9 410 78 25 2.53 

during class. (0.88) 

2 | have difficulty working with other students 19.6 30.4 30.9 88 13 2:33) 
on out-of-class projects. (0.93) 

3 | have trouble leading class discussions. 9.3 28.4 39.7 17.1 5.5 ah 
é | have difficulty participating in large group 14 34.2 410 11.8 20 2.60 
discussions. (0.91) 

me ne : 4 3.10 

5 | have difficulty giving oral presentations. 6.5 20.1 40.7 22.1 0.6 (1.05) 
6 | have trouble wording what | want to say 25 148 37.4 312 144 3.39 
quickly enough. (0.99) 

| worry about saying something in case | , P 3.42 

make a mistake in my English. a ae at aa ue (1.09) 
| do not know how to say something in P , 3.40 

8 English. 18 1.8 44.2 29.1 3.1 (0.92) 
9 do not know the best way to say something 18 10.3 38.7 312 18.1% 3.54 
in English. (0.96) 


Note. Cronbach’s Alpha: .897 > .70, Normality: Skewness: -.015, Kurtosis: -.174 (+/-1.96). 1= Never; 
2=Hardly; 3=Sometimes; 4=Often; 5=Always. 


Table 1 highlights the speaking difficulties experienced by undergraduate respondents 
in OBE. While a majority (48.7%) felt comfortable working in small groups, a significant 
proportion (41%) struggled with out-of-class tasks to some extent. Over half of the respondents 
(59%) expressed confidence in working with others after class, suggesting a potential mismatch 
between in-class and out-of-class support. 22.6% faced challenges in leading discussions, while 
32.7% struggled with conducting oral presentations effectively. Most participants (45.3%) 
experienced difficulties articulating their intended utterances, with a similar percentage (42.1%) 
lacking the necessary skills to express their thoughts in English. Furthermore, 45.7% reported 
anxiety and a lack of confidence due to inaccuracies in word usage, highlighting the importance 
of vocabulary development and accuracy in business communication. Notably, only a small 
percentage (12.1%) felt proficient in expressing themselves in English. 


Table 2 
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Target Needs for Student Use (Required Speaking Activities) 


No. Required Speaking Activities (N=398) 1 (%) 2 (%) 3 (%) 4 (%) 5 (%) M (SD) 

{ Giving a formal speech or oral 48 23.6 415 204 98 3.07 
presentation. (1.01) 

eee ee . , 3.31 

2 Participating effectively in discussions. 1.0 5.8 43.5 30.4 9.3 (0.88) 
Communicating effectively with peers in 3.37 

3 small group discussions, collaborative 0.8 14.8 41.7 32.2 10.6 (0 89) 
projects, or out-of-class study groups. ; 
Simulating role plays in particular 3.03 

4 scenarios (e.g., talking with clients, 3.5 15.6 43.7 28.6 8.5 (0 94) 


answering clients’ calls, etc.). 


Note. Cronbach’s alpha: .769 > .70, Normality: Skewness: -.189, Kurtosis: -.120 (4/-1.96). 1= Never; 


2=Hardly; 3=Sometimes; 4=Often; 5=Always. 


The second construct of the study assessed the effectiveness of speaking activities in 
OBE from the undergraduate perspective (see Table 2). Data analysis revealed that 30.2% 
of participants agreed that engaging in speaking activities, such as formal speeches or oral 
presentations, was beneficial for improving speaking proficiency. 39.7% of participants 
believed that active participation in discussions would enhance their speaking skills. A majority 
of participants (42.8%) considered practicing speaking skills through small group discussions, 
collaborative projects, and out-of-class activities as a viable approach in OBE. Lastly, 37.1% of 
participants found the use of role plays in OBE to be useful. 


Table 3 


Learning Needs for Student Use (Learning Styles) 


No. Learning Styles (N = 398) 1(%) 2(%) 3(%) 4(%) 5(%) M(SD) 

{ | prefer to work collaboratively (in groups or pairs) 28 93 309 332 148 3.48 (0.95) 
when | am asked to perform a speaking task. 

9 | prefer to work individually when | am asked to 45 231 467 178 78 3.01 (0.95) 
perform a speaking task. 

3 | prefer to work with the whole class when | am 55 251 40.2 206 85  3.02(1.01) 
asked to perform a speaking task. 
| prefer to use digital literacy (e.g., information, 

4 media, ICTs) to enhance my learning of speaking 2.8 78 33.2 427 13.6 3.57 (0.92) 
skills. 

3 | think teachers should take a traditional role in 10.1 324 440 9.5 4.0 

uke 2.65 (0.93) 

control of everything in class. 

6 | think teachers should work as a facilitator to guide 13 38 19.1 447 342 4.01 (0.88) 


the learning of students. 


Note. Cronbach’s alpha:.704> .70, Normality: Skewness: -.254, Kurtosis: 1.107 (+/-1.96). 1=Strongly 


Disagree; 2=Disagree; 3=Neutral; 4=Agree; 5=Strongly Agree. 


Table 3 reveals the undergraduates' preferences for learning styles in OBE, highlighting 
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a strong preference for collaborative learning, the use of digital literacy, and a facilitator role for | 463 
teachers. Nearly half (48%) of the undergraduates preferred collaborative learning for speaking 
activities, suggesting a strong preference for group work over individual learning (25.6%). 
While a majority (75.9%) acknowledged the role of teachers as facilitators in the classroom, 

only a small proportion (13.5%) favored a traditional teacher-centered approach. Over half of 

the undergraduates (51.8%) indicated a strong interest in receiving support with digital literacy, 
highlighting the importance of technology in their language learning process. 


Table 4 
Learning Needs for Student Use (Perceptions Towards the Course) 


Perceptions towards the Course 


No. 1(%) 2(%) 3(%)  4(%) 5(%)  M(SD) 


(N = 398) 

1 Overall, | am satisfied with the business English 18 80 49.7 34.2 63 3.35 (0.79) 
major. 

2 lam satisfied with the business English course, 20 143 503 279 55 3.21 (0.83) 
especially speaking. 

3 lam satisfied with the current teaching approaches 25 131 450 327 68 3.28 (0.87) 
to learning speaking skills. 

4 | am satisfied with the teachers of the business 15 38 329 44.0 178  3.73(0.85) 


English major. 


Note. Cronbach’s alpha:.866 > .70, Normality: Skewness: -.180, Kurtosis: -.607 (+/-1.96). 1=Strongly 
Disagree; 2=Disagree; 3=Neutral; 4=Agree; 5=Strongly Agree. 


Table 4 presents undergraduate perceptions of the business English major, revealing 
generally positive sentiment towards the program, OBE, and their teachers. While only 9.8% of 
participants expressed dissatisfaction with the course, 40.5% reported satisfaction, and 49.7% 
remained neutral. Similarly, 33.4% expressed satisfaction with OBE, with 16.3% reporting 
some dissatisfaction and 50.3% remaining neutral. Regarding speaking teaching methods, 40% 
of participants agreed with their effectiveness, while 15.6% disagreed, with the remaining 45% 
holding a neutral position. Over 60% of participants expressed satisfaction with their teachers. 


Table 5 
Learning Needs for Student Use (Perceptions Towards the Use of Instructional Materials) 


Perceptions towards the use of instructional 
materials (N = 398) 
| think the current instructional materials are suitable 


1 1.0 12.1 495 33.9 3.5 3.27 (0.76) 
for my career development. 


No. 1(%) 2(%) 3(%) 4(%)  5(%) M(SD) 


| think the current textbooks used in class own the 


2 appropriate level of difficulty for learning speaking 
skills. 0.8 10.8 485 343 5.5 3.33 (0.77) 


To some extent, the business English textbook 
for speaking skills is appropriate for me to use 
(e.g., systematicity, practicality, and matching with 
students’ needs). 


Note. Cronbach’s alpha:.855 > .70, Normality: Skewness: .001, Kurtosis: .052 (+/-1.96). 1=Strongly 
Disagree; 2=Disagree; 3=Neutral; 4=Agree; 5=Strongly Agree. 


08 78 46.5 37.2 78 3.43 (0.78) 


The fifth construct of the study assessed students’ perceptions of the instructional 
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materials used in OBE (see Table 5). The findings revealed that 37.4% of participants reported 
that the materials were appropriate for their career growth, while 50% held a neutral stance on 
their suitability for their current learning level. On the other hand, 45% considered the textbook 
used for speaking skills to be appropriate, while 46.5% had a neutral attitude. Only 8.6%, 
however, expressed a negative attitude towards it. 


Inferential Results 


Following a descriptive analysis of needs analysis for OBE, an independent-samples 
t-test was conducted to measure potential gender differences in speaking needs. The alpha level 
was set at .05. Table 6 shows that the variances between the male and female groups were not 
homogeneous (F (1, 396) = 11.84, p < .001). Therefore, the assumption of equal variances was 
violated. Despite this violation, the results did not show a statistically significant difference 
between male and female respondents regarding their speaking needs for OBE, ¢ (36.12) = 
-1.91, p> .05. 


Table 6 
Independent-Samples Test Results of Overall Speaking Needs Perceived Based on Gender 


Levene's Test 


for Equality of t-test for Equality of Means 

Variances 
Caneel 95% Confidence Interval of 

F p t df Significance Mean the Difference 

2-Sided p Difference 
Lower Upper 

EVA 1184 <001 -254 396 011 -.198 -.350 -.045 
EVNA 1.91 36.12 .064 -.198 -.408 012 


Note. EVA = Equal variances assumed, EVNA = Equal variances not assumed 


As shown in Table 7, a one-way ANOVA was conducted to examine the effect of 
participants' demographic variables (level of study, age, years of English study, and English 
proficiency) on their perceived speaking needs for OBE. The one-way ANOVA revealed a 
significant difference in perceived speaking needs across different levels of study, F (3, 394) = 
5.797, p < .001. However, no significant differences were found in perceived speaking needs 
based on age, years of English study, or English proficiency (p > .05). To further examine the 
significant mean difference in speaking needs across the four levels of study, a post-hoc test was 
conducted at a 5% significance level. Identifying which specific group means differ is crucial 
for developing targeted interventions and addressing the unique needs of students at various 
academic levels (Kim, 2015). 


Table 7 
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ANOVA Results of Overall Speaking Needs Perceived by Students 
Demographic Variables SS df MS F p 
Between Groups 682 3 227 1.198 310 
Age Within Groups 74.744 394 .190 
Total 75.426 397 
Between Groups 3.188 3 1.063 5.797 —-<.001 
The levels of study Within Groups 72.237 394 183 
Total 75.426 397 
Between Groups 637 3 212 1.118 342 
The years of study English Within Groups 74.789 394 .190 
Total 75.426 397 
Between Groups 1.073 4 .268 1.417 227 
ue sea Within Groups 74.353 393 189 
Total 75.426 397 


Note. SS = Sum of Squares, MS' = Mean Square. 


The Scheffe Post-Hoc test was run in this stage. Table 8 above discloses that there 
was only a significant difference between the speaking needs in Chinese business English 
undergraduates majoring in Year 4 and Year 3, while other levels were not significant in terms 


of speaking needs. 


Table 8 


Results of Post-hoc Test for the Variable of the Levels of Study Enrolled 


Dependent Variable Levels of Study MD SE p Inference 
Year 2 -.023 304 1.000 Not significant 
Year 1 Year 3 103 307 .990 Not significant 
Year 4 -.157 .306 .967 Not significant 
Year 1 023 304 1.000 Not significant 
Year 2 Year 3 126 .057 179 Not significant 
Overall Speaking Needs Year 4 -.134 .050 072 Not significant 
Perceived by Students Year 1 -.103 307 990 Not significant 
Year 3 Year 2 -.126 .057 179 Not significant 
Year 4 ~.259° .063 <.001 Significant 
Year 1 157 .306 .967 Not significant 
Year 4 Year 2 134 .050 072 Not significant 
Year 3 .259° .063 <.001 Significant 


Note. MD = Mean Difference, SE = Std. Error. 


Discussion 
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Needs Analysis for Target and Learning Dominance 


This study employed Hutchinson and Waters' (1987) needs analysis framework to 
comprehensively assess the speaking needs of business English undergraduates, aiming 
to align the curriculum with OBE. Above all, the findings regarding speaking difficulties 
among Chinese business English undergraduates highlight a considerable challenge in OBE. 
Respondents reported struggles with fluency, accuracy, pronunciation, vocabulary, and accent, 
aligning with previous research (Guo, 2022; Lv, 2018; Xie & Chen, 2019; Wang, 2014). This 
suggests a persistent gap between the theoretical knowledge acquired in prior education and 
the practical application of speaking skills needed for professional success (Xie, 2020). The 
findings underscore the importance of prioritizing speaking development within business 
English programs. This gap may be attributed to several factors. A lack of appropriate learning 
contexts and systematic instruction focusing on the communicative aspects of language 
acquisition may contribute to learners' difficulties (Amoah & Yeboah, 2021; Shen & Chiu, 2019). 
Traditional teaching approaches often prioritize grammatical accuracy and knowledge over 
the development of communicative competence (Richards & Rodgers, 2014). Consequently, 
students may struggle to apply their language skills in authentic communication settings, 
prioritizing problem-solving over effective interaction. These findings call for a pedagogical 
shift towards more communicative and context-rich learning environments. Business English 
teaching should prioritize the development of practical speaking skills through authentic tasks, 
interactive activities, and real-world scenarios. 

Participants clearly demonstrated a preference for communicative approaches in OBE, 
as evidenced by the findings related to required speaking activities. They consistently favored 
activities like oral presentations, discussions, role-plays, and verbal idea-sharing, suggesting a 
clear understanding of the importance of active engagement in developing speaking proficiency 
(Abulhul, 2021; AlSaqqaf et al., 2024; Amoah & Yeboah, 2021; Sirisrimangkorn, 2021). 
This aligns with pedagogical principles that emphasize the use of language for authentic 
communication, opinion-sharing, and information transfer (Richards & Rodgers, 2014; Xie 
& Chen, 2019). These findings underscore the value of incorporating interactive activities, 
particularly those that simulate real-world communication, into OBE contexts. Participants 
recognized the benefits of such activities in fostering pronunciation skills, critical thinking, 
and confidence (Brooks & Wilson, 2015; Girard et al., 2011). This reinforces the notion that 
language acquisition thrives on active participation and the opportunity to use language for 
meaningful purposes (Amoah & Yeboah, 2021). The consistent interest in communicative 
activities suggests a shift away from traditional, teacher-centered approaches and towards more 
student-centered, interactive learning environments that promote autonomy and engagement. 

Concerning the findings related to perceived learning styles, participants demonstrated 
a strong interest in collaborative learning, utilizing digital literacy, and a facilitative role 
for teachers in OBE. This understanding can shape the development of effective teaching 
strategies and the integration of technology to enhance student learning experiences. Prior 
research supports the value of collaborative learning, showing that active learners appreciate 
opportunities for peer interaction and problem-solving (Silitonga et al., 2020). Collaborative 
tasks foster communication skills, critical thinking, and a sense of ownership over learning 
(Huang & Hu, 2016; Johnson et al., 2014). Similarly, digital literacy has been shown to enhance 
student engagement, interaction, and the development of higher-order skills (Misir, 2018; Otto 
et al., 2024). This approach can shift the role of the teacher from a traditional lecturer to a 
facilitator, promoting student autonomy and self-directed learning (Misir, 2018; Reeve, 2006). 
The strong preference for both collaborative learning and digital literacy underscores the need 
for amore student-centered approach to OBE. This involves incorporating pedagogical practices 
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that prioritize collaborative tasks, technology integration, and student autonomy, creating a 
more engaging and effective learning environment for 21st-century language learners (Jose, 
2021). By adopting these elements, educators can effectively cater to the specific needs and 
preferences of Chinese business English undergraduates. 

Meanwhile, the findings related to perceptions towards OBE courses reveal a generally 
positive sentiment among Chinese undergraduates, with a majority expressing satisfaction 
or neutrality regarding the major, OBE, and their teachers. However, varying opinions on 
aspects like course satisfaction, speaking teaching methods, and OBE itself highlight areas 
for further improvement and development in the business English curriculum and teaching 
approaches. These results align with previous research findings. Dai and Liu (2016) observed 
that Chinese business English students were generally satisfied with their courses and had a 
positive perception of the teaching methods. Similarly, Xie and Chen (2019) confirmed that 
business English courses were perceived as effective in terms of content and teaching methods. 
One contributing factor to this satisfaction may be the perceived relevance of business English 
to employment opportunities (Zhang, 2007). The combination of linguistic knowledge and 
business-related skills makes business English more directly applicable to career development 
than studying English and business separately. Furthermore, the positive teacher-student 
relationship and teacher charisma were also found to contribute significantly to student 
satisfaction with business English courses (Guan, 2021). Students who feel supported and 
respected by their teachers are more likely to be engaged in the learning process and achieve 
better results. Finally, students' intrinsic motivation for English learning plays a significant 
role in their satisfaction (Chemir & Kitila, 2022). Students who are motivated to learn English 
are more likely to find the courses valuable and rewarding. These findings highlight the need 
for ongoing efforts to refine curriculum design, teaching methodologies, and the teacher- 
student relationship to address specific areas of concern and further enhance student learning 
experiences within the context of OBE. 

In addition, the findings related to undergraduate respondents' perceptions towards using 
instructional materials highlight a need for updating and aligning the content of materials used 
in OBE. While participants generally expressed satisfaction, the results indicate a need for 
materials that better equip students with the skills and knowledge necessary for their future 
career development. This finding aligns with previous research emphasizing the importance 
of tailored materials in ESP courses (Zhang & Zhang, 2020). Students find materials that 
reflect their English proficiency and prior knowledge valuable for their future professional 
development (Jia, 2022). The choice of topics, language accuracy, and coherence of materials 
should align with students' needs and expectations. This emphasis on materials aligned with 
career development reflects a shift towards a more student-centered approach in ELT, where 
students are encouraged to learn using authentic materials and practice their communication 
skills in real-world contexts (Guan, 2018; Ye, 2018). This shift prioritizes the development of 
English for professional purposes over general English. However, the findings of this study 
contradict Dai and Liu's (2016) previous findings, suggesting that current English resources 
for business English teaching in China do not adequately consider students' future career 
development. This discrepancy may be attributed to the challenges of teaching in large classes 
with diverse learning levels, making it difficult to develop materials that perfectly suit all 
learners (Jia, 2022). This finding emphasizes the need for a careful and deliberate approach 
to materials selection and development within OBE. Materials should be carefully curated to 
reflect the specific needs and aspirations of students, equipping them with the language skills 
and knowledge necessary for success in their chosen professional fields. 


Respondents’ Demographic Differences for the OBE Needs Analysis 
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The independent-samples t-test results revealed no statistically significant gender 
difference in their needs for OBE learning among Chinese business English undergraduates. This 
finding aligns with previous studies conducted by Dinsa et al. (2022) and Ahsanah (2020) that 
found no considerable impact of gender on speaking skill development. However, it contradicts 
Xu's (2021) study, which reported significant gender differences in teaching methods preferences 
among English-major students, and Gholami et al.'s (2013) findings that male and female EFL 
students exhibit significant differences in their speaking needs. The absence of a statistically 
significant gender difference in this study could be attributed to several factors. First, the 
opportunity to learn and practice OBE may be equally available to both genders in a real-world 
learning environment, including equal access to educational resources, potentially leading to 
similar OBE requirements. Furthermore, the pedagogical approaches employed for OBE are 
likely gender-neutral, providing similar learning experiences for both genders. Additionally, it 
is widely acknowledged that both genders possess the innate ability to develop language skills 
when given equal opportunities (Liu, 2010). The standardized nature of textbook selection and 
curriculum design across institutions may contribute to the observed similarity in needs. Liu 
(2010) highlights that educational institutions are often directed to choose English textbooks 
from a specified selection, leading to a standardized approach in curriculum development. Liu 
and Ren (2021) further corroborate this by noting that teachers frequently base their lesson 
plans on the chosen textbook, the teaching outline, and the institution's prescribed schedule. 
Given these standardized conditions, it is reasonable to infer that male and female students may 
experience similar needs in OBE learning, suggesting a convergence in their requirements. 

The findings regarding speaking needs demonstrate a significant difference between 
Year 4 and Year 3 Chinese business English undergraduates, suggesting that academic level 
significantly impacts language learning requirements and outcomes. This aligns with previous 
research highlighting the distinct speaking needs of students at different academic levels (Dinsa 
et al., 2022; Gholami et al., 2013). The observed difference in speaking needs between Year 4 and 
Year 3 students could be attributed to several factors. Year 4 students, having undergone a more 
advanced curriculum and prolonged exposure to English learning, may have developed more 
sophisticated speaking skills and proficiency (Wang et al., 2024). Additionally, the increasing 
need for effective communication skills in preparation for career growth and the practical 
experience gained through internships may further emphasize the importance of speaking 
proficiency for Year 4 students. Furthermore, the traditional Chinese EFL context may play a 
role in this observed difference. Many university freshmen enter higher education with limited 
experience in practicing academic English orally, as their previous learning experiences often 
focus on text-based learning (Wang et al., 2024). However, university teaching arrangements 
are designed to progressively develop speaking competencies, culminating in the final year 
(Anjum, 2020; Xie, 2016). This demonstrates that formal education includes not only academic 
knowledge but also equips students with the practical skills needed for the professional world. 


Conclusions and Implications 


This study shed light on the specific needs of Chinese business English undergraduates, a 
significant population within the global EFL context, where the demand for English proficiency 
is paramount for success in the globalized business landscape, particularly in terms of speaking 
skills. The findings underscore the importance of adopting a needs-driven approach to 
curriculum design, highlighting the need to incorporate student-centered, communicative, and 
interactive approaches into teaching methods and materials. Further evaluation was conducted 
to test the demographics and speaking needs for business English, revealing the academic year 
as a key factor in OBE instruction development. This suggests that while certain demographic 
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factors do not influence the necessity for business English, the academic level, specifically the 
transition from Year 3 to Year 4, may play a role in shaping students’ requirements for language 
proficiency in a business context. These actions can enhance students' language proficiency and 
create a more engaging and effective learning environment. Crucially, the study acknowledged 
the unique challenges and context of Chinese EFL education, suggesting that pedagogical 
strategies need to be adapted to address the specific needs of this population. Moreover, the 
implications extend beyond the Chinese context, offering valuable insights for other EFL 
settings facing similar challenges in business English education. This study aligned with 
international trends in language teaching that emphasize communicative competence, student 
autonomy, and interactive learning environments. While the results of this study can be used 
as a reference to develop speaking teaching materials, it is important to note that the study has 
several limitations. This study focused on the perspectives of business English undergraduates 
in Chinese universities. However, it did not include input from other stakeholders, such as 
teachers or employers, and the self-reported data should be used with caution. Suggestions for 
future research include obtaining and analyzing the speaking needs of business English students 
from public and private institutions separately and accessing the speaking needs of master's 
and Ph.D. students majoring in business English. Despite the lack of significant demographic 
differences in this study, further research is needed to evaluate potential variations in specific 
aspects of OBE needs across them. This could involve examining detailed data on individual 
needs and preferences, as well as exploring the potential impact of broader societal factors on 
their learning experiences. 
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Abstract 


Recent advances in educational neuroscience research underscore the need for a comprehensive analysis 
of articles in this field; such scrutiny can elucidate the practical implications of neuroscience findings in 
education and illuminate future research directions. The purpose of this study was to conduct a descriptive 
content analysis of articles published in the field of educational neuroscience. The data collected through 
the Educational Neuroscience Articles Classification Form were analyzed via content analysis. The 
diversity of research in the field of educational neuroscience and the growth in the number of studies in 
recent years demonstrate that this discipline represents a comprehensive and potentially effective field. 
In addition, developing concrete suggestions for practice strengthens the integration of educational 
neuroscience into educational practices. Furthermore, future research needs to focus more on converting 
theoretical knowledge into practical applications and assessing the impact of these applications. 
Moreover, increasing interdisciplinary cooperations is crucial for educational neuroscience to realize its 
full potential. Finally, further studies conducted through mixed methods and qualitative research methods 
provide a more comprehensive and in-depth understanding of educational neuroscience. On the other 
hand, the following recommendations have been made based on these insights: applied research studies 
can be conducted to directly integrate neuroscientific findings into educational practices. In addition, 
cooperation among educational scientists, neuroscientists, and researchers in the field of psychology can 
make the integration of neuroscientific findings into educational practices more efficient. Last but not 
least, research conducted through qualitative and mixed methods provides a more comprehensive and 
in-depth understanding of educational neuroscience. 

Keywords: educational neuroscience, educational neuroscience studies, content analysis 


Introduction 


Until Aristotle, knowledge could be used freely without sharp boundaries. With Aristotle’s 
reductionism, interdisciplinary boundaries began to emerge (Flogie et al., 2015). Driven by 
reductionism, disciplines such as psychology, sociology, and philosophy, which contribute 
to learning and teaching practices, have historically been studied as distinct fields. However, 
humans are biological, psychological, and social beings. In order to address human learning, the 
human being must be evaluated in “all” its aspects. In this way, education can achieve a holistic 
perspective. One discipline that helps foster such a perspective in education is neuroscience. 

Neuroscience has influenced several disciplines, with education being undoubtedly one 
of them. This is due to the fact that brain imaging studies enable us to observe the regions of the 
brain that are active during the learning process (Kaygisiz, 2022). Imaging studies have provided 
new findings on how human beings learn. Ravet and Williams (2017) have believed that these 
findings hold importance as they have allowed for the development of new educational programs 
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and learning approaches. By sharing neuroscience findings with educators, it becomes easier 
to view individuals as a whole, taking into account traits such as their motivation, emotional 
states, conceptual understanding, and problem-solving skills (Koyuncu, 2017). The bridge that 
conveys the findings of neuroscience to educators is educational neuroscience. Educational 
neuroscience seeks to translate findings from neuroscience research into educational practice. In 
doing so, it focuses on integrating theories from cognitive psychology, neuroscience, education, 
and even language theories (Kweldju, 2019). While neuroscience shows where to look in the 
brain, which neural functions have problems, and/or how they work, educational neuroscience 
serves as a bridge in transforming this information into interventions in the light of pedagogical 
principles (Howard-Jones et al., 2016). 

Articles are one of the means of disseminating educational neuroscience studies to 
educators. Examining educational neuroscience articles is a critical step in understanding the 
impact of neuroscience on educational practice. This is because articles connect neuroscientific 
research with educators, contributing to the development of a deeper understanding of 
learning processes. There are numerous studies in the literature that focus on what educational 
neuroscience is (Bruer, 2016; De Corte, 2018; Dubinsky et al., 2022; Diindar-Coecke, 2021; 
Jamaludin et al., 2019; Pincham et al., 2014; Rueda, 2020; Tolmie, 2015; Vaninsky, 2017). 
There are also studies that comprehensively handle what neuromyths are, aiming to measure 
their prevalence in education and include suggestions/measures (Ferrero et al., 2016; Geake, 
2008; Herwegen et al., 2022; Krammer et al., 2021; Pasquinelli, 2012; Sullivan et al., 2021). 
Studies also exist investigating how to use the neuroimaging techniques used to measure brain 
activity and cognitive processes in the context of education (Barreto & Soltanlou, 2022; Dan & 
Reiner, 2017; Plerou & Vlamos, 2016; Sohn et al., 2004). Research addressing and discussing 
the ethical issues regarding the use of neuroscience in education has also been published 
(Hardiman et al., 2012; Howard-Jones & Fenton, 2012; Lalancette & Campbell, 2012; Zocchi 
& Pollack, 2013). 

An array of studies is present that address the question of “Can using neuroscience 
data in education contribute to educational programs?” (Abdillah, 2018; Kitchen, 2020; 
Watagodakumbura, 2017). Additionally, research exists that develops suggestions and 
methodologies for the field of educational neuroscience (Fathiazar et al., 2020; Leisman, 2022; 
Nowinski, 2021). In the field of educational neuroscience, topics such as the effect of music on 
learning and brain development, mathematics learning, language learning, and motivation have 
also been investigated (Berteletti et al., 2022; Diivel et al., 2017; Luria et al., 2021; Procopio 
et al., 2022; Ruiz-Mejias et al., 2021; Velez & Holguin, 2021; Ventura-Campos et al., 2022; 
Zhang, 2018). Furthermore, research has been conducted to develop educational programs, 
methods, techniques, and strategies for learning difficulties such as dyslexia and dyscalculia, 
and accurately redefine these difficulties using brain imaging data (Anderson et al., 2020; 
Bedard et al., 2016; Dresler et al., 2018). 

Various articles have been published in the field of educational neuroscience and this 
field has especially been the focus of researchers’ attention over the past decade. Therefore, 
examining educational neuroscience articles could hold additional merit. This endeavor 
can reveal the potential for using neuroscience findings in education. Moreover, it can help 
researchers understand current trends and explore future research topics in the field of educational 
neuroscience. For these reasons, this study sets out to conduct a content analysis of educational 
neuroscience articles. Content analysis reveals the similarities and differences between studies 
and the relationships between research dimensions, thereby providing a framework for the 
discipline in question (Calik & Sézbilir, 2014). 

This study represents an important step in understanding the applicability and impact of 
neuroscientific findings in education. Integrating neuroscientific findings into education allows 
for a deeper comprehension of learning processes and the shaping of educational practices based 
on this new knowledge. Neuroscientific research enables a more comprehensive assessment 
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of individual attributes such as motivation, emotional states, conceptual understanding, and 
problem-solving skills, thereby fostering a holistic perspective in education. In this context, a 
content analysis of educational neuroscience articles provides significant insights into current 
trends in the field, explores future research topics, and reveals the potential applications of 
neuroscientific findings in education. Therefore, this study offers a valuable foundation for 
determining the impact of neuroscientific findings on education and understanding the direction 
of research in this domain. 

The aim of the present study was to conduct a descriptive content analysis of articles 
published in the field of educational neuroscience. To address this aim, the following research 
questions were probed. 

1. What is the distribution of the articles based on their publication years? 

2. What is the distribution of the articles based on their topics? 

3. What is the distribution of the articles based on their research methods? 

4. What is the distribution of the articles based on their subject areas? 

5. What suggestions are provided by the educational neuroscience articles? 


Research Methodology 
General Background 


In the present study, descriptive content analysis was utilized. Descriptive content 
analysis involves classifying independently conducted studies, evaluating and synthesizing 
their trends and research findings, and systematically and holistically addressing the studies 
(Calik & Sézbilir, 2014). This study adopted descriptive content analysis to reveal the general 
trends of articles published in the field of educational neuroscience up to December 31, 2022, 
and provide insights for future studies on this subject. 


Sample 


The population of the research consisted of all full-text accessible articles on educational 
neuroscience available in the Web of Science, Wiley Online Library, Taylor and Francis, 
Science Direct, SAGE Journal, Scopus, EBSCO, ERIC, PubMed, JSTOR, Directory of Open 
Access Journals (DOAJ), and Google Scholar databases. As a result of searches conducted with 
relevant keywords in these databases, all accessible full-text articles were analyzed individually 
and comprehensively, thus achieving a complete count. A complete count is considered to be 
achieved when all elements in the population are accessed, thoroughly examined, and analyzed 
to obtain the data (Arastaman, 2020, p. 177). 

To access the articles, the keywords “educational neuroscience’, “neuroeducation”, and 
“mind, brain and education” were used. Filters were applied to search for the keywords in the 
“title”, “abstract”, and “keywords” sections, with the research type set to “articles” and the 
language to “English”. This approach served to reduce the likelihood of accessing irrelevant 
studies by restricting the search to specific sections rather than the full text (Ultay et al., 2021). 
No start date was set for the search period, with the end date fixed on December 31, 2022. 
According to Calik and Sézbilir (2014), when using descriptive content analysis, it is necessary 
to include studies from an extensive time frame to identify the overall trend on the topic in 
question. In this study, a complete count of all-time research was undertaken to ensure breadth 
rather than depth, thereby aiming to discern the general trend. To avoid potential losses and 
verify the obtained studies, the search process was repeated at regular intervals until December 
31, 2023, resulting in the identification of 394 articles. During the preliminary reading, 78 
articles were found to be unrelated to education and were thus excluded from the study. The 
remaining 316 articles were included in the analysis. 
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Instrument and Procedures 


Research data were collected through the “Educational Neuroscience Articles 
Classification Form”. This form was developed by the researcher by taking into account the 
content analysis research in the literature (Caliskan & Serge, 2018; Durmus & Caliskan, 2022; 
Taskiner-Sereflioglu & Kuligc-Mocan, 2021) in order to ensure content validity. The draft 
form was sent to a faculty member experienced in content analysis to obtain expert feedback. 
Based on the feedback received, the form was revised and finalized. The final version of the 
Educational Neuroscience Articles Classification Form was made of six sections as; descriptive 
information about the identity of the article, publication year, topic, method, subject area and 
suggestions they presented. 


Data Analysis 


In this study, the data collected using the “Educational Neuroscience Articles Classification 
Form” were analyzed through content analysis. Categories for content analysis were generated 
at the beginning of the study in accordance with the research questions. The units of analysis 
were placed under the relevant category, and their frequencies were provided. A pilot study 
was conducted on a subset of ten randomly selected articles to ensure accuracy and consistency 
in coding the data. The selected studies were coded independently by the authors. The coding 
performed was compared, and efforts were made to reach a consensus. Thus, any potential 
errors in the coding process were addressed proactively. During the coding process, the first 
author’s coding was periodically reviewed by the second author, identifying any deficiencies 
and necessary modifications. This process continued until a final decision was reached on the 
coding. 


Research Results 
Publication Years of the Articles 
The distribution of the articles based on their publication years is presented in Table 1. 


Table 1 
The Distribution of the Articles Based on Year of Publication 


Year f Year f 
1997 1 2014 11 
1998 1 2015 21 
2006 2 2016 19 
2007 5 2017 21 
2008 10 2018 22 
2009 7 2019 29 
2010 6 2020 24 
2011 26 2021 31 
2012 19 2022 40 
2013 21 
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The inaugural publication in educational neuroscience was Bruer’s article titled 
“Education and the Brain: A Bridge Too Far” in 1997. From 1997 to 2010, 2008 recorded 
the highest number of published articles. A notable increase in articles was observed in 2011 
compared to previous years. However, the number of articles published in 2014 declined 
compared to the previous three years. After 2015, the publication count began to rise again, 
averaging 22 articles per year from 2015 to 2020. The substantial increase in articles in 2021 
and 2022 is particularly noteworthy. This trend indicates that educational neuroscience has 
gained significant interest from researchers, and the number of articles published in this field 
has increased in recent years. 


Topics of the Articles 


The distribution of the articles based on their thematic focus is shown in Table 2. 


Table 2 
The Distribution of the Articles Based on Their Topics 


Topic f 
Defining and introducing educational neuroscience 44 
Neuroscience and interdisciplinary relations in education 35 
Applying neuroscience findings to education 32 
Investigating brain activity in the learning process using imaging methods 31 
Effects of neuroscience on learning 30 
Neuromyths 21 
Teachers’ level of neuroscience awareness and teacher education 18 
Neuroscience and cognitive and affective development 17 
Project, model proposal 13 
Neuroscience findings and program development in education 13 
Neuroscience-based technological innovations and education 12 
The relationship between neuroscience, ethics, and philosophy 10 
Designing educational games according to the principles of neuroscience 6 

Neuroscience-based course design 4 


Other 30 


The topics covered in educational neuroscience articles are quite diverse. The most 
frequently addressed topic is defining and introducing educational neuroscience. Following 
this are topics such as interdisciplinary relationships between neuroscience and education, the 
application of neuroscience findings to education, studying brain activities during the learning 
process using imaging methods, and the effects of neuroscience on learning, respectively. Other 
thematic foci in the articles include neuromyths, the level of neuroscience awareness among 
teachers and teacher training, as well as neuroscience and cognitive and affective development. 
There are also studies on project and model proposals, neuroscience findings and educational 
program development, neuroscience-based technological innovations, the relationship 
between education, neuroscience, ethics, and philosophy, designing educational games based 
on neuroscience principles, and neuroscience-based lesson design. It can be concluded that 
educational neuroscience articles focus on defining and introducing the field, highlighting the 
importance of interdisciplinary relationships for a holistic perspective in education, translating 
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prevalence of neuromyths in education while offering recommendations and measures. 


Research Methods of the Articles 


The distribution of the articles based on their research methods is displayed in Table 3. 


Table 3 
The Distribution of the Articles Based on Their Research Methods 


Research Methods i 
Unspecified 141 
Literature review 76 
Quantitative 61 
Mixed 21 
Qualitative 17 


Out of the 316 articles analyzed, 141 did not specify a research method. 76 of the articles 
were literature reviews. Among the remaining articles, quantitative methods were the most 
commonly used, followed by mixed methods and qualitative methods. Qualitative methods 
were the least preferred research paradigm in the articles. 


Subject Areas of the Articles 


The distribution of the articles based on their subject areas is demonstrated in Table 4. 


Table 4 
The Distribution of the Articles Based on Their Subject Areas 


Subject Area ns 
Educational Sciences (Education - Teaching — Learning) 229 
Mathematics Education 28 
Teacher Training 18 
Special Education 10 


Language Education 


Education Programs 


9 
7 
Instructional Technologies 6 
Other (STEM/ Science Education/ Physical Education/Philosophy of Education) 4 
3 
1 
1 


Music Education 


Assessment and Evaluation 


Lifelong Learning 


Educational neuroscience articles primarily focus on the areas of education, teaching, and 
learning. Additionally, specific subjects such as mathematics education, teacher training, and 
special education also hold a significant share. Other notable areas include language education, 
educational programs, and instructional technologies. This diversity highlights the broad scope 
and potential impact of educational neuroscience research. 
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Suggestions of the Articles 479 


The distribution of the suggestions presented in the articles is shown in Table 5. 


Table 5 
The Distribution of the Articles Based on the Suggestions They Presented 


Suggestions f 
No suggestion 176 
Recommendations on research methods and design 44 
Neuroscience training for teachers 26 
Examining learning-teaching methods and evaluating their effects 20 
Conducting research that will contribute to the understanding of learning with imaging methods 20 
Adopting a neuroscience-based interdisciplinary approach in education and strengthening 16 
interdisciplinary cooperation 

Developing neuroscience-based and technology-supported educational games 16 
Investigating the impact of neuroscience on learning 12 
Increasing cooperation in the fields of education and neuroscience 12 
Conducting in-depth research in educational neuroscience 8 

Taking steps to debunk neuromyths 8 

In-depth study of the brain and learning processes 7 

Building a bridge between laboratory and classroom practices 7 

Strengthening educational neuroscience through empirical research 6 

Translating neuroscience data into a language that teachers can understand 5 

Development and evaluation of neuroscience-based educational programs 4 

Examining the ethical aspect of neuroscience interventions 3 


The most striking finding in Table 5 is that no suggestions were presented in 176 
out of the 316 articles analyzed. The most frequently presented suggestions in educational 
neuroscience articles pertain to the methods and designs of future research. Longitudinal 
studies with larger samples and control groups can be given as examples of this suggestion. 
These suggestions highlight the methodological and design aspects that should be considered 
to ensure that educational neuroscience research is based on a stronger and more robust 
foundation. Neuroscience education for teachers, including neuroscience literacy training for 
teachers and teacher candidates, and the addition of neuroscience courses in teacher education 
programs, is the second most common suggestion. These suggestions aim to enhance teachers’ 
knowledge and skills in neuroscience, help them develop more effective teaching strategies in 
the classroom, and support students’ learning processes. The third most frequently presented 
suggestion is the investigation of teaching and learning methods and the evaluation of their 
effects. Examples of this suggestion include researching the relationship between spatial factors 
in visual neuroscience and the learning process and exploring the link between brain-friendly 
teaching and language skills. These suggestions emphasize important practical applications. 
Another suggestion is to conduct research that will contribute to the understanding of learning 
with imaging methods. Examples of this suggestion include conducting research on the neural 
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correlates of problem-solving and examining the brain’s responses to mathematical activities. 
These suggestions are aimed at gaining a deeper understanding of how learning processes 
take place and how they can be improved using different brain imaging techniques and other 
neuroscientific tools. Adopting a neuroscience-based interdisciplinary approach to education 
and strengthening interdisciplinary collaboration was also recommended. Focusing on building 
a bridge between education and neuroscience and ensuring interdisciplinary content integration 
are examples of this suggestion. These suggestions focus on adopting a neuroscience-based 
interdisciplinary approach to education and strengthening interdisciplinary collaboration. The 
suggestions also include the development of neuroscience-based and technology-supported 
educational games. Research is recommended to ensure the effective integration of educational 
games, neuroscience-based learning principles, and technology. 

Although other suggestions appear less frequently, each highlights important aspects of 
the various dimensions within the field of educational neuroscience. These suggestions draw 
attention to the need for a broader and more in-depth examination of educational neuroscience. 
As aresult, the educational neuroscience articles provide suggestions for future research topics, 
while suggestions for practice are not adequate. 


Discussion 


The main purpose of this study was to conduct a descriptive content analysis of the articles 
published in the field of educational neuroscience. The data collected with the “Educational 
Neuroscience Articles Classification Form” were analyzed utilizing descriptive content 
analysis. To sum up, the following major findings were reached in the study. First, the field of 
educational neuroscience has been a field that attracts the attention of researchers. The number 
of articles on this subject has started to increase in recent years. The increase observed in 2021 
and 2022 is particularly noteworthy. On top of this, educational neuroscience articles mostly 
focused on defining and introducing educational neuroscience. In addition, various topics, such 
as emphasizing the importance of interdisciplinary relations, translating the findings of brain 
imaging studies into learning and teaching practices, measuring the prevalence of neuromyths 
in education, and providing suggestions/measures, were also addressed. Quantitative methods 
were the most commonly used research paradigm in the articles, followed by mixed methods 
and qualitative methods. Qualitative methods were the least frequently employed. Educational 
neuroscience articles were primarily concentrated on topics related to education, teaching, 
and learning. Additionally, specific subject areas such as mathematics education, teacher 
training, and special education were also prominently featured. Other notable subject areas 
included language education, educational programs, and instructional technologies. Generally, 
educational neuroscience articles offered suggestions for future research topics but fell short on 
practical application suggestions. 

The scrutiny into the distribution of articles by publication year revealed a significant 
increase in educational neuroscience articles, particularly in the last decade. This trend indicates 
that research at the intersection of neuroscience and education is gaining increasing interest 
and that academic contributions to this field are growing. The notable rise in the number of 
articles in 2021 and 2022 highlights that educational neuroscience is a current and dynamic 
field of research. This increase can be viewed as an indicator of the belief in the applicability 
of neuroscientific findings in education and the technological advancements in this field (Ravet 
& Williams, 2017). 

The distribution of educational neuroscience articles by topic is quite diverse, and this 
diversity shows that the discipline represents a wide range of research areas. The greatest focus 
was on defining and introducing educational neuroscience. This emphasizes the importance of 
research aimed at understanding the basic principles and application areas of the discipline (Bruer, 
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2016). Another significant theme was the interdisciplinary relationship between neuroscience 
and education. This is a critical area for understanding how neuroscience findings can be 
integrated into educational practices and how educational processes can be optimized (Howard- 
Jones et al., 2016). Moreover, the study of brain activity during the learning process using 
imaging methods is also of great importance. This kind of research provides us with important 
insights into the biological basis of the learning process and how we can apply this knowledge 
to educational practice (Kaygisiz, 2022). The study of neuromyths helps us understand how 
misconceptions and myths in education can be addressed based on neuroscientific foundations. 
This is important for raising teachers’ level of neuroscience awareness and developing more 
effective teaching strategies (Koyuncu, 2017). The focus of educational neuroscience articles 
on a variety of topics provides a broad coverage of the discipline. This contributes to making 
improvements in various areas of education and managing learning processes more effectively. 
However, further broadening and deepening this diversity is essential to fully unlock the 
discipline’s potential. 

The examination of the research methods in the articles revealed that, notably, many of 
them did not specify a research method. This is due to the theoretical or interpretative nature 
of some of the articles. Literature reviews and quantitative studies stood out among the articles 
conducted with a specific method. The prevalence of quantitative research may result from the 
importance of objective and measurable data in educational neuroscience. However, considering 
the scarcity of qualitative studies, it can be suggested that there is a need for more in-depth and 
contextual investigations in this field. 

When the subject areas of the articles were examined, it was discovered that educational 
neuroscience articles mostly focused on education, teaching, and learning. This could be due 
to the importance attached to integrating neuroscientific findings into education and training 
processes. Education, teaching, and learning are the areas directly influenced by educational 
neuroscience and where its applications are most prevalent (Howard-Jones et al., 2016). In 
addition, specific subject areas such as mathematics education, teacher training, and special 
education also occupy a significant position in educational neuroscience research. Research in 
these areas aims to improve educational practices and increase student achievement by focusing 
on these issues (Bruer, 2016). Among other important subject areas were language education, 
educational programs, and instructional technologies. This diversity demonstrates the broad 
scope and potential impact of educational neuroscience research. 

When the suggestions presented by the articles were analyzed, 176 of the 316 articles 
did not present any suggestions. This finding can be explained by the fact that the articles were 
mostly review articles that dealt with defining and introducing neuroscience. The most prevalent 
suggestion in the educational neuroscience articles concerned the methods and designs of future 
research. This finding can be interpreted as researchers’ demand for methodological innovations 
to reach more robust and valid results in educational neuroscience studies. Neuroscience literacy 
training for teachers was the second most common suggestion. This finding can be interpreted 
as a strong emphasis in the articles on the need to train teachers to integrate neuroscientific 
knowledge into classroom practice. According to Bruer (2016), increasing teachers’ knowledge 
and skills in neuroscience would help them develop more effective teaching strategies. The 
third most common suggestion was to research teaching-learning methods and evaluate their 
effects. This specific finding reveals that theoretical knowledge in educational neuroscience 
should be transformed into practical applications, and the effects of these applications should 
be analyzed. Conducting research that will contribute to the understanding of learning with 
imaging methods was another suggestion presented in the articles. This finding emphasizes 
the importance of research that will be conducted utilizing brain imaging techniques. 
This is because the use of brain imaging techniques in educational research will make 
neuroscientific data more directly applicable to learning processes. The suggestions to adopt 
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a neuroscience-based interdisciplinary approach in education and to strengthen collaboration 
were also included in the articles. This finding draws attention to the importance of integrating 
educational neuroscience studies into different disciplines. Among the other suggestions was the 
development of neuroscience-based and technology-supported educational games. This finding 
can be interpreted as drawing attention to the need for using technology in education in creative 
and interactive ways. While the other suggestions occurred less frequently, each underscores 
significant aspects and dimensions within the field of educational neuroscience. For example, 
suggestions such as investigating the effect of neuroscience on learning, increasing cooperation 
in the fields of education and neuroscience, conducting in-depth research, and taking steps to 
debunk neuromyths emphasize the need for a broad and in-depth examination of the field. To 
summarize, it can be inferred that educational neuroscience articles suggest topics for future 
investigation, but suggestions for practice are lacking. This shortcoming reveals the necessity 
of developing practical suggestions. The lack of practical suggestions emerges as an aspect that 
needs to be emphasized more in future research. At this point, it can be said that it is important 
to evaluate the potential of educational neuroscience research to provide more suggestions and 
to integrate it more effectively into educational practice. 


Conclusions and Implications 


The present study has established several key conclusions regarding the field of 
educational neuroscience. It has been confirmed that the diversity and increasing number of 
research studies indicate that this discipline is both comprehensive and potentially influential. 
Furthermore, it has been found that developing concrete suggestions for practice will enhance 
the integration of educational neuroscience into educational practices. The study has also 
established that future research should focus more on converting theoretical knowledge into 
practical applications and evaluating the impact of these applications. Additionally, it has been 
verified that increasing interdisciplinary collaborations is crucial for educational neuroscience 
to realize its full potential. Finally, it has been demonstrated that conducting research with mixed 
methods and qualitative approaches will provide a more thorough and in-depth understanding 
of the field. 

Future research should focus on conducting applied studies that directly integrate 
neuroscientific findings into educational practices. These studies should include concrete 
suggestions on how teachers can use neuroscientific knowledge in classroom settings. 
Additionally, to unlock the full potential of educational neuroscience, it is crucial to increase 
interdisciplinary collaboration. Future research involving collaboration between educational 
scientists, neuroscientists, and psychologists can enhance the efficiency of integrating 
neuroscientific findings into educational practices and increase the applicability of such research. 
Lastly, research utilizing qualitative and mixed methods should be conducted to provide a more 
thorough and profound understanding of educational neuroscience. 
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Abstract 


This research explores the educational beliefs of select fourth-year preservice Filipino mathematics 
teachers enrolled in the Bachelor of Education major in Mathematics program in the second semester of 
the 2022-2023 academic year in a state university in Bulacan, Philippines, via qualitative-exploratory 
research. Three qualitative tools were used: a metaphor construction task, unstructured questions, and 
a drawing task. Thematic analysis and intercoder reliability checking were implemented. Based on the 
findings, the first theme, the teacher as a knowledge dispenser belief, features the imperative conduct of 
the dispensation of knowledge; the second theme, the teacher as a reliable improver belief, highlights the 
formation of space for student participation after dispensing knowledge; the third theme, teacher as an 
equity promoter belief, highlights the significance of addressing the needs of the students while dispensing 
knowledge; and the last theme, teacher as a strategic scaffolder belief, highlights combining, extending, 
and maximizing all knowledge, experiences, and learning opportunities to align with and attain learning 
objectives. The teacher-as-knowledge dispenser belief is more teacher-centered, the teacher-as-reliable 
improver and teacher-as-equity promoter beliefs are mixed teacher-centered and student-centered, and 
the teacher-as-strategic scaffolder belief is more student-centered. 

Keywords: educational belief model, mathematics teaching, preservice teachers, student-centered, 
teacher beliefs, teacher-centered 


Introduction 


Mathematics is a course that stresses the building of new knowledge over previous 
knowledge. Mathematics teachers would all agree that they put some order into their 
mathematics teaching. In several mathematics classrooms, it is believed that learning includes 
grasping specific procedures and a body of knowledge. Similarly, it is thought that the task of 
teachers is to communicate the material in simply practicable parts, preferably from easy to 
challenging levels, and to do the accurate technique, after which students work on practice drills 
individually (Goos et al., 2007). This 'school mathematics’ culture is labeled as information 
transfer or transmission. Barr and Tagg (1995) have connected this scenario of information 
transfer to what they call the instruction paradigm, which has the mission and purpose of 
providing students with instructions that aim to transfer knowledge. This paradigm asserts to be 
more teacher-centered than student-centered in its form. 

However, a contrasting 'inquiry mathematics’ culture believes that knowledge cannot 
be transmitted directly from teacher to student. That is, educators have long identified the 
advantage of active student participation in supporting deep learning of key mathematical ideas 
and procedures (Ignacio, 2024). Here, students learn by joining in math tasks, asking queries, 
suggesting assumptions, and solving new or unfamiliar problems. Barr and Tagg (1995) have 
attached this scenario of deep learning support to what they called the learning paradigm, 
which establishes itself as producing learning by creating powerful learning environments. This 
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learning paradigm asserts to be student-centered. In mathematics education, student-centered 
learning, which is undeniably rooted in the very notion of constructivism, pays attention to 
how observations, informal experiences, and patterns can be changed into stronger illuminating 
ideas via encounters with thought-provoking tasks (Ignacio & Paras, 2024). "Excellent 
mathematics teachers are responsive to all aspects of the context in which they teach—learning 
environments they establish, lessons they plan, their uses of technologies and resources, their 
teaching practices, and the ways in which they assess student learning" (Goos et al., 2007, p. 3). 

Accordingly, mathematics teachers perform teaching based ona diverse set of professional 
and/or personal beliefs and values (Clemson & Clemson, 1994). All the behaviors that teachers 
take are built on models/principles. In some instances, they embrace the theories of others, e.g., 
colleagues or writers, but in all cases, they fit them to their own beliefs and preferences, those 
ways of operating which they feel good about and those which they think worthwhile. On the 
other hand, it is one of the central pieces of educational thinking that equal opportunities for 
learning should be offered to all students. To deliver to all the students these opportunities in 
mathematics, teachers need to evaluate their beliefs about how students learn. Teachers can 
then employ theoretical perspectives that are appropriate for learning situations. These beliefs 
must be carefully explored as early as their preservice teaching years. However, for preservice 
teachers, the pressures of restructuring are heightened by the learning demands of first-time 
teaching (Lloyd, 2006). Their personal experiences in conventional mathematics classrooms 
affect their teaching and learning views. Due to the potential reported advantages of operating 
in a learning paradigm, the tendency to employ student-centered classrooms encourages not 
only Western nations but also some countries in the East, like the Philippines. 

As a consequence, as a Filipino teacher-researcher in the field of mathematics teaching, it 
is my responsibility to explore this issue. Hence, the present research is interested in exploring 
and outlining patterns of educational beliefs of preservice Filipino mathematics teachers in 
mathematics teaching, reflecting teacher- and student-centered notions. 


Rise of Western Student-Centered Learning 


Early pursuit of learning concentrated on behaviorism (Thanh-Pham, 2011). For 
behaviorists, teachers convey the material to the students to transmit knowledge. Students must 
get all the pieces of information the teachers would like to communicate, attend, and listen 
to them as this is a way to acquire knowledge. "Perception became discrimination, memory 
became learning, language became verbal behavior, intelligence became what intelligence 
tests test" (Miller, 2003, p. 141). As stated by Boghossian (2006), for behaviorism, "Often, 
the form of conditioning used to achieve desirable behavior is a lecture-based pedagogy. [It] 
rejects a dialectical process and does not actively involve the learner" (pp. 716-720). As a 
response, cognitivists have taken into attention what occurs within the brain of a learner, the 
cognitive processes that are fundamental to learning processes. Learning is a cognitive process 
where learners find the crucial parts to solve a problem and, eventually, connect them (Bélanger, 
2011; Gardner, 1985). Meanwhile, the world was branded by capitalism (Thanh-Pham, 2011). 
Hence, development and support for a skills agenda came out of the private sector. There was 
a large interest in 'big-tech' companies seeking to take advantage of skills development. This 
compelled the academic world to outcomes known as 21*-century skills. The 21*-century skills 
are proxy terminologies that imply abstract future skills. This required a skilled workforce and 
a new school curriculum to prepare such a workforce (Kennedy et al., 2023). Education is seen 
as a way to achieve social benefits, have an open supply of marketable workers, and be able to 
pass wealth and job-related positions (Engel & Rutkowski, 2008; Woodford & Quiles, 2019), 
producing learners that can satisfy the demands of capitalists (Peters, 2001). 
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Thus, behaviorism became outdated. This leads to the spread of Western student- 
centered teaching and learning (SCTL) practices. Western countries have transformed the 
means of spreading knowledge (Lin, 2016). Western SCTL acknowledges process-oriented, 
student-centered approaches and concentrates further on learning from experiences, activities, 
and collaboration (Chang, 2021; Jacobs & Renandya, 2019; Thanh-Pham, 2011). Student- 
centered learning (SCL) approaches are often described by comparing them with traditional 
instructional methods, which are distinguished by more teacher direction (Pedersen & Liu, 
2003). Student-centered teaching is about optimizing students' learning possibilities (Doyle, 
2011). Western SCL was sustained by constructivism. In constructivism, prior knowledge is 
essential in constructing new knowledge. Assisting students to construct understanding in a 
learning situation can be realized via the lens of a scaffold, i.e., building on students' ideas. 
Undeniably, the tendency to copy and enforce Western traditions on non-Westerners has been 
anticipated as globalization—1.e., cross-border trade and accessibility of resources of various 
countries via interdependence of economies, cultures, and populations—upholds those Western 
practices, e.g., teaching-learning, is freely offered in the East, e.g., Asia (Engel & Rutkowski, 
2008; Thanh-Pham, 2011). 


On Asian Education Reform 


"The last two decades have witnessed ‘a global wave’ of large-scale educational reform 
as influenced by globalization" (Lou & Restall, 2020, p. 113). The realization of Western 
SCTL has shown challenges in global contexts (e.g., from Western to non-Westerners) as 
it involves the intersection of its underlying idea with the established values and culture of 
non-Western schools, the related reality and boundaries, and the beliefs adopted by teachers. 
While values refer to something desirable that is culture-bound (Jocano, 2008), beliefs shape 
the implementation of a learning approach (Pedersen & Liu, 2003). Reportedly, researchers 
cited that Western SCTL practices caused difficulty for both Asian instructors and students 
to rebuild their thinking concerning teaching and learning and share control for the learning 
course as co-partners, e.g., those with Confucian heritage backgrounds (Chang, 2021; Phuong- 
Mai et al., 2005; Van Schalkwyk, 2015). Asian learning values uphold hierarchy. Thanh-Pham 
(2011) called this situation to have a high power distance. In an Asian learning culture, high 
power distance stresses hierarchical relationships, which teaches students to obey and listen 
to teachers. As stated by Van Schalkwyk (2015), "It is a fallacy to think that Asian students 
automatically know how to collaborate toward successful completion of a learning task ... 
[Asian] prefers a high amount of structure, well-structured tasks, and linear thinking, limiting 
creative efforts" (pp. 33-35). While a small power distance in a Western SCTL culture spreads 
the power among the members, favors individualism or independent thinking, and is inclined 
to prioritize cognitive competence, Asians observe conflict avoidance significantly as they 
manage to prioritize friendships over cognitive expertise (Chang, 2021; Phuong-Mai et al., 
2005; Thanh-Pham, 2011). Some of these Asian practices are not different from the Filipino 
traditional value system. Values refer to something desirable, and desirability is culture-bound. 
In the ethnographic research done among the diverse ethnolinguistic groups in the Philippines 
since 1967, Felipe Landa Jocano (2008), an Anthropology Professor Emeritus at the University 
of the Philippines, said, "Individualism is not part of our traditional culture. It is from Western- 
influenced formal education. Group activities are more productive when leadership is done 
with a personal touch ... Communication tends to bog down unless it projects a personalized 
attention" (pp. 63-64). 
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Some Reported Asian Teacher Educational Beliefs 


At the class level, SCL pertains to students being the center, enthusiastically included in 
the learning process, as they are in charge of their own learning processes, plans, and decisions, 
while instructors increase chances for interaction and learning (Lou & Restall, 2020). But to 
make this happen, as mentioned by Filipino authors Alonzo et al. (2021), to change teachers' 
practices for a more SCL practice, teacher beliefs are needed to be reviewed, as they note, 
"One of the most cited and well-argued factors that hinder teachers’ ability to change their 
practices is the failure to change their belief system" (p. 36). It considers teacher beliefs (or 
educational beliefs) as an independent construct (Mo, 2020). As a working definition, from a 
sociocultural perspective, teacher beliefs denote "individual, subjectively true and value-laden 
mental constructs that are of relatively stable results of substantial social experience and that 
have a significant impact on one's interpretations of and contributions to classroom practices" 
(Skott, 2015, p. 19). 

This highlights that teachers and their educational beliefs are vital to any educational 
reform. Teacher beliefs involve mental patterns in social and cultural settings where individuals 
gain experiences. Hence, teacher beliefs are confined to cultural and social perspectives (Wang 
& Hsieh, 2014). Through this lens, we say that teachers’ beliefs are interconnected with what 
they have experienced. For instance, regarding the impact of teacher beliefs on practices, 
although teachers had strong beliefs about SCTL, some may return to more traditional ones, 
both pedagogy and assessments, due to a lack of experience and knowledge (Cunningham, 
2021). Teacher beliefs and experiences support teachers' adoption and realization of their 
educational-related practices. In a Vietnamese context, it seems that once teachers have shaped 
solid beliefs about the profits of SCL, both for students and themselves as good teachers, they 
will be more ready to modify their teaching practices, a move from lecture-based teaching to a 
more constructivist one (Nguyen et al., 2019). In a Taiwanese context, most teachers supposed 
that although usual lecture-based practices were helpful, they were ineffective in developing 
creativity, logic, and necessary analysis skills (Huang & Asghar, 2016). In a Chinese context, 
technology use was still restricted to teacher-centered principles instead of SCL practices (Li & 
Ni, 2010). In a Turkish preservice teachers' context, most participants' espoused beliefs tended 
to be blended, combining teacher-centered and student-centered approaches. Their beliefs are 
more traditional since they have been taught more traditional practices since primary school 
(Sendurur, 2018). In another study, they might favor constructivist beliefs but exhibit traditional 
teaching since they have not acquired the crucial skills and knowledge for constructivist practices. 
They had struggles making student-centered approaches (Kaymakamog&glu, 2018). Their beliefs 
and experiences play a large part in successfully fulfilling SCL (Aslan, 2022). In a Korean 
context, it has been labeled that Korean schools' teaching practices blend teacher-centeredness 
and student-centeredness; SCL is penetrated by Confucian cultural beliefs and practices, e.g., 
observing high power distance (Yang & Tan, 2019). In a Singaporean context, the strengthened 
extent of SCTL was frequently tied in with issues related to the teachers' earlier beliefs about 
pedagogy. That is to say, the changes in beliefs can be described by encounters in the teachers’ 
beliefs about pedagogy that led to shifts in practices in the classroom (Tan & Nashon, 2013). In 
an Omani context, teacher beliefs shape the realization of student-centered curricula. Teachers 
who hold optimistic assumptions linked to SCL but face challenges in performing these practices 
in university have been noted as substantial obstructions to espousing SCL (Ambusaidi et al., 
2021). 
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On Preservice Mathematics Teacher Educational Beliefs 


The primary researcher deems himself to have a social constructivist worldview and 
a critical realism research philosophy. As per Creswell (2009), social constructivists seek an 
insight into the realm where they work and live, dependent on the participants’ opinions of the 
situation being explored, to make a sound judgment of the meaning others say about the world. 
On the other hand, a critical realist argues that, as researchers, what occurs in the social sphere 
can be known if they know the social forms that offer growth to the experiences they seek to 
comprehend-1.e., what people see is only a piece of the broader picture (Saunders, 2019). While 
the present researcher believes in subjectivity and the fluidity of the truth of the world around 
us, in this study, they are concerned with recognizing a certain context to generate an empirical 
and realistic truth from them. 

Beliefs in mathematics instruction are more connected directly to genuine daily teaching 
(Burroughs & Schmidt, 2014). Explicitly, while teachers with traditional foundations in the 
form of beliefs and experiences are assumed to use didactic teaching practices, teachers with 
constructivist beliefs and experiences are more expected to use SCTL practices. Teacher 
beliefs and experiences must be considerably explored before supposing any modifications in 
teacher practices. As per Stebbins (2008a), "Researchers explore when they possess little or 
no scientific knowledge about the group, process, activity, or situation they want to examine 
but have reason to believe contains elements worth discovering" (p. 327). This should be 
considered as early as their university years in the teacher-education. As educators of various 
mathematics courses, this is crucial to us. Teacher beliefs are vital in mathematics teaching 
(Tang & Hsieh, 2014), are central to mathematics teachers’ professional capabilities, and are 
critical to perceiving circumstances as they influence the adoption of behaviors (Felbrich et 
al., 2014). As per Bldmeke (2014), in line with mathematics education, "... [teacher] beliefs 
are thought to guide perceptions and actions, they can be regarded crucial for the application 
of knowledge in classroom situations, and they can be conceptualized as a bridge between 
knowledge and teaching" (p. 9). 

Future [preservice] teachers' beliefs can be fundamental to their view of situations in the 
classrooms and judgment on what sort of knowledge to use or in what way to react (Felbrich 
et al., 2014). As a socioculturally shaped mental construct, the teacher beliefs may serve as a 
means for understanding why and how things are done and should be. In light of the working 
definition of teacher beliefs offered by Skott (2015), the present researcher is interested in 
exploring and outlining patterns in preservice teachers' educational beliefs in mathematics 
teaching, taking into consideration teacher-centered and student-centered teaching-learning 
notions. As a Filipino mathematics educator and researcher, this study sought to address one 
issue: the educational beliefs of the preservice Filipino mathematics teachers in mathematics 
teaching. 


Research Methodology 
Research Design 
Qualitative-exploratory research design was used in this study (Stebbins, 2001). It 
explored and outlined the teacher beliefs of Filipino preservice teachers in mathematics 
teaching. It started when the data were examined. As the data are being gathered, ideas emerge 


and are documented. The records were analyzed to refine usual properties into generalizations 
and concepts on the subject in consideration. 
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Participants 


The participants of this study were fourth-year teacher-education students enrolled in 
the Bachelor of Education major in mathematics program at a state university in Bulacan, 
Philippines, in the second semester of the 2022—2023 school year. This study used purposive 
sampling (Fraenkel & Wallen, 2009). The participants should be enrolled in a teacher-education 
institution. This study concentrated on the Bachelor of Education major in mathematics students 
with preservice teaching experiences. And so, only the available fourth-year mathematics 
preservice teachers were selected purposively from the mathematics program (N = 28). Of these 
participants, 10 (36%) were males and 18 (64%) were females. As for the ethical issues, respect 
for anonymity, informed consent, and voluntary participation were observed. An identification 
number was assigned to each participant. 


Data Collection and Procedures 


The researcher asked for consent from the Dean of the College of Education to administer 
the study and, after getting permission, started with the data collection. To generate meaningful 
patterns, three (3) tools were used patterned from the study of Yesilyurt (2022)—a metaphor 
construction task, a drawing task, and unstructured questions. The participants were requested 
to complete a metaphor construction task (e.g., A teacher is like __ because __.. A student is 
like _ because __.). Next, they were requested to draw a classroom scenario associated with 
mathematics teaching-learning. Lastly, they were asked to explain their drawings, specifically 
the teaching-learning process and the keys and hindrances to success in schools. The preservice 
teachers were given sufficient time to complete the metaphor construction task, draw a classroom 
scenario of an ideal mathematics teaching-learning, explain their drawings, and share their 
insights on possible keys and hindrances to success in the school. The data were gathered in the 
second semester of the school year 2022—2023. The data were subjected to qualitative analysis. 


Data Analysis 


To analyze data, and since the study is exploratory, thematic analysis was implemented. 
"Thematic analysis is a method for identifying, analyzing, and reporting patterns (themes) 
within data" (Braun & Clarke, 2006, p. 79). Accordingly, there are six phases of thematic 
analysis: familiarize oneself with the data, generate initial codes, search for themes, review 
potential themes, define and name themes, and produce the report. While coding is a way of 
indexing or categorizing the text to establish a framework of thematic ideas (Gibbs, 2007), the 
themes capture something important about the data concerning the research objectives (Braun 
& Clarke, 2006). The researcher wrapped himself with the data, identified the set categories, 
and then tried to search for themes within each category (Efron & Ravid, 2013). Intercoder 
reliability checking was employed to substantiate how the data needed to be coded, i.e., 
measures of agreement between coders assessed through percent agreement (O'Connor & Joffe, 
2020). The data are each categorized by the researcher and an external coder from the College 
of Education. From the first intercoder reliability check, the percent agreement obtained was 16 
out of 28 (57%). The researcher notified the external coder of the results and settled possible 
differences before doing the second intercoder reliability check. From the second intercoder 
reliability check, the percent agreement was 26 out of 28 (93%). The researcher resolved the 
remaining differences with the external coder until the codes were settled. 
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Research Results 


To explore and outline the teacher belief patterns of preservice teachers in mathematics 
teaching in a Filipino context, at first, the participants were asked to complete open-ended 
metaphor construction tasks, i.e., "A teacher is like ... because ..." and "A student is like ... 
because ...". The researcher reads the responses several times to familiarize themselves with 
the data. Accordingly, the metaphors were coded as teacher-centered, student-centered, or 
mixed. The researcher, afterward, searches for initial themes. Based on thematic coding, four 
(4) themes emerge from the metaphors constructed by twenty-eight (28) participants. Teacher- 
centered beliefs referred to the metaphors, drawings, and unstructured data responses that 
implied teachers were knowledge dispensers; mixed beliefs indicated teachers were reliable 
improvers and equity promoters, and student-centered beliefs referred to implied teachers as 
strategic scaffolders. Of the teaching metaphors, eight (8) metaphors show the teacher as a 
knowledge dispenser, seven (7) metaphors as a reliable improver, eight (8) metaphors as an 
equity promoter, and five (5) metaphors as a strategic scaffolder (See Table 1). 


Table 1 
Themes Distribution of Teaching Metaphors from the Metaphor Construction Task 


Teacher 


Beliefs Main Themes Metaphor Samples Highlights 


Teacher- 
centered Teacher-as-knowledge 
dispenser belief (8) 


knowledge dispenser, 
compass, library, book, 
writer, hero, actor 


This theme highlights the imperative conduct of 
the dispensation of knowledge. 


smith, sharpener, chalk, This theme highlights the formation of space for 


Teather eres sculptor, cookie mold, student participation after dispensing knowledge. 


Mixed improver belief (7) legacy 
Teatherse-cauit aidenar walevand sua This theme highlights the significance of 
TS 9 : : : addressing the needs of the students while 
promoter belief (8) water sprinkler . : 
dispensing knowledge. 
Student- — This theme highlights combining, extending, and 
‘ puzzle solver, artist's ae : 
centered Teacher-as-strategic maximizing all knowledge, experiences, and 


materials, open water, 


scaffolder belief (5) lighthouse, torch 


learning opportunities to align with and attain 
learning objectives. 


Teacher-as-Knowledge Dispenser Belief 


From the first main theme, knowledge dispenser, preservice teachers holding teacher- 
centered beliefs viewed the teacher as a dispenser of knowledge that fills young minds with 
concepts they need to learn. Like a compass, the teacher leads students on the right path by 
giving them direction, motivating them to learn things they do not know, and showing them 
how to walk through. One must recognize that in this belief, without the teacher, no exact 
direction and instruction will help students achieve their desires. Like a library full of books, 
they bring knowledge and information to students to acquire new ideas and eventually change 
their views and behaviors. Just like a writer, the teacher is the one who writes and inputs 
knowledge to students until they become individuals full of wisdom and knowledge. Since the 
teacher teaches all that students need, students must be willing to listen and pay attention, i.e., 
absorb and attain new knowledge, skills, and behavior. The teacher views students as people 
with the potential for sufficient feeding. The teacher greatly influences student development, 
i.e., students who are willing to learn can learn, as many opportunities can be realized. Like a 
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hero, the teacher performs the profession no matter how difficult. And like an actor, the teacher 
must appropriately uphold an image that society wants. Teachers must be cautious of their 
actions inside and outside school and be careful in dispensing knowledge via curricula and tasks 
(See Table 1 and Figure 1a). 

Table 2 shows that the lack of confidence and support, fear, and high expectations from 
others believably contribute to accepting the teacher-as-knowledge dispenser belief among 
this group of students, i.e., heavily relying on teachers for knowledge by readily listening to 
and absorbing each lesson taught and resorting to working passively to acquire information 
and knowledge. In this belief [in students' perspectives], students give almost all their trust 
and confidence in acquiring and developing learning to substantially competent teachers. As 
an expectation, [in teachers' perspectives], students are assumed to obtain all the required 
information the teacher would like to dispense. This theme highlights the imperative conduct of 
the dispensation of knowledge. 


Table 2 
Some Responses that Show a Teacher-as-Knowledge Dispenser Belief 


ID #1 #24 #9 

On Teaching- "The teacher provides "Forme, the teaching-learning "Teaching-learning process is 

Learning Process knowledge that the learners process is a combined a give-and-take process. The 
acquire [Learning] is process where teacher teacher gives knowledge to 
obtaining new knowledge, assesses understanding students while students take 


On Hindrances 
to Class/School 
Success 


skills, or ability that will 
bring change to the person 
acquiring it." 


"The following things hinder 
me from being successful 
in class ... Lack of [teacher] 
support ... low confidence." 


needs, formulates teaching, 
and memorizing strategies 
and assesses the outcomes 
of instruction ... Successful 
students always focus on the 
tasks at hand and always 
listen to the teacher." 


"Expectations and fears that 
| might not be able to do my 
best in what | am asked to do 
in school ... Expectations of 


this knowledge ... Learning is 
acquiring new knowledge." 


"Lack of confidence. | am 
sometimes afraid to try new 
things or showcase my talent or 
knowledge." 


other people ..." 


The teachers are the ones who prepare and teach the lesson. [Teachers] make sure that students 
understand and acquire new information. Students are the learners of the lessons that are prepared and 
taught by the teachers. They are expected to obtain the objective[s] ... I don't have enough confidence to 
believe in my skills. Sometimes, I doubt myself. Even if I know that I can do it, there is something that 
makes me step back. (ID#26) 


Itis assumed that when an environment where no one is judged or criticized for committing 
mistakes, especially on complex concepts, is formed with a culture of appreciative individuals, 
i.e., it is well known to all that they are surrounded by people that will keep showing support 
and help, serving each one in reaching goals, assisting each other to go outside their boxes of 
comfort zones, just decreases students' pressures, turning a different perspective on academic 
failure, forming an extra level of a willingness to explore and learn among students. 


I entered this school and class because I believe it will help me to grow and prosper as a future 
educator ... lam afraid to go outside the box because I fear failing. I always work inside my comfort zone. 
I am worried that people will judge me when I commit mistakes. Then, I realized we would not learn if 
we didn't fail. If I fail, at least I try and learn something from it. (ID#8) 
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Teacher-as-Reliable Improver Belief 


From the second main theme, reliable improver, preservice teachers holding mixed 
teacher-centered and student-centered beliefs viewed a teacher as a reliable improver shaping, 
molding, and honing students towards becoming successful members of society. With this 
belief, students might not be ready to face life without teachers’ assistance, support, and 
direction. By showering students with knowledge and honing their skills, the teachers can turn 
them into wonderful human beings, confident in showing the world how beautiful they are, and 
turn them into excellent obra maestras via their innovative, artistic, and creative imagination. 
Like smiths who derust and sharpen blunt swords, teachers are bound to their duties, though, 
at times, they are probably underrated and underappreciated as they work behind students. 
The teacher influences students through mind, heart, and soul. Like a sharpener, the teacher 
is the one who hones students’ education. With the teacher, a generation will sprout from their 
innocence. Although students might be hardheaded and erratic, the teacher should not be 
annoyed because it is their role to cure ignorance. Like chalk, the teacher instills in the students 
with appropriate skills. Like a sculptor and a cookie mold, the teacher is the one who shapes 
students, identifying their strengths and weaknesses based on the tasks they have been given, 
forming consistency, infusing creativity, building their personalities to be good and acceptable 
in society, and developing them to know what is right and wrong, seeing them becoming more 
refined. As a comfort, good teachers are legacies that cannot be easily forgotten (See Table 1 
and Figure 1b). 

Table 3 shows that the lack of support, inspiration, and self-motivation believably 
contribute to accepting the teacher-as-reliable improver belief. As teachers strategize the class 
operations through various methods and follow stated class objectives, students undeniably 
desire some support that may help them stir their minds, e.g., through thought-provoking 
questions and tasks, with an amount of lightness, evident through the word 'smile.' Students 
appreciate the accommodating atmosphere that is established within the class. They desired 
teachers not to direct the floor constantly but, at some point, to let them explore and construct 
their own knowledge, i.e., letting teachers initially discuss related topics but allowing them to 
explore afterward. In this belief [in students' perspectives], students are assumed to analyze and 
construct knowledge, which will later be improved and refined through student participation after 
the teacher has dispensed necessary information. As an expectation [in teachers' perspectives], 
students are supposed to improve as teachers become reliable and consistent in safeguarding 
student participation. This theme highlights the formation of space for student participation 
after dispensing knowledge. 
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Table 3 


Some Responses that Show a Teacher-as-Reliable Improver Belief 


ID 


#7 


#6 and #15 


On Teaching- 
Learning Process 


On Hindrances 
to Class/School 
Success 


"... teacher makes a lesson plan according to a 
curriculum. [Teacher] has objectives meant to be 
achieved at the end of the lesson ... the teachers 
will utilize methods to achieve the listed objectives 
... Teachers must not always be on stage. The 
students must be allowed to construct their own 
knowledge ... | [as a student] best learn when 
reading a book or getting taught by a teacher 
wherein he/she provides thought-provoking 
questions. In short, | mostly learned when my 
metacognition skills were triggered by the lessons." 


"| hate to say this because it is personal, [but] 
most of our family members are not the sort of 
people you can find some inspiration from. They 
are people who break the castle of success 
and confidence that | am slowly building ... To 
the matter of financial support, | get no reason 
of becoming more contented in studying. It is 
because if | receive the things | want from them, 
there is no debate that | would have been more 


"Learning is gaining new knowledge from 
others and also from self ... The teacher 
teaches, and the student listens first, then, 
exchanging ideas will be provided." 

"In teaching-learning process, a teacher 
and students are involved. In order for a 
student to understand the lesson, as a 
teacher, | let them answer on their own 
understanding after discussing the lesson 
... with a smile." 


"[Pessimism] Being optimistic [helps] 
because there are problems, [and we must] 
learn to smile and face the other day ... 
Laziness." 


"In my own opinion, | will be more successful 
in class or school by setting motivation. 
Another is creating my main goal to have 
a guide on what to do next to become 


successful.” successful For me, procrastination 
hinders me from being more successful 
because every time | have something to 
pass, | always do it the night before. But 
| am now knowledgeable enough to leave 


that kind of trait." 


I learn mathematics by writing lectures, listening to the teacher, answering math problems, and 
following the teacher when answering the examples ... For me, it is important to praise the students so 
that they will be encouraged to answer ... it is important that they [teachers] will have [safeguard] student 
participation in the class and will not bore the students. Also, having the participation of the students, it 
will help them [students] to follow what is being discussed, and they can know immediately where they 
are having difficulties, and they can ask their teachers to repeat the discussion or give tips on how to 
remember it easily. (ID#15) 


To deal with student self-motivation issues, it is vital to highlight the value of discipline 
and focus on studies and its objectives among the students by having winning study habits. 
Giving tasks and activities with a particular goal may be considered to students requiring peer- 
to-peer interaction or, at least, teacher-student interaction, i.e., with a teacher beside them ready 
to check and facilitate learning processes during class exploration and discussion when deemed 
necessary. Lack of self-motivation seems to exist when they are alone, with a long due, without 
someone to check on them. 


By paying attention to the ideas and objectives, it encourages us to improve our own quality of life 
and feeling of self-worth ... There are barriers to being successful in school, such as lack of motivation, 
barriers in social, cultural, and beliefs. If students are not motivated in their studies, they tend not to be 
able to focus on school. In the 21“ century, peer-to-peer learning in schools is now more important than 
ever. That's why interaction is important in every classroom ... I realize that successful students are not 
[merely] smarter than other students. They're just more disciplined and focused, and they've developed 
winning study habits. (ID#16) 
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Teacher-as-Equity Promoter Belief 


From the third main theme, equity promoter, preservice teachers holding mixed teacher- 
centered and student-centered beliefs viewed the teacher as a promoter of equity, i.e., by being 
patient and persistent. Like a gardener who maintains the beauty and health of a seed and plant, 
a teacher sees potential in every student, especially those struggling, and helps them develop 
and grow. With this belief, teachers do not just blame the students if they are not growing 
well; i.e., they think of ways to help them grow. Students, like a sponge, have the potential to 
expand their understanding and skills by soaking up all the learning opportunities around them. 
The teacher selects and prepares the course lessons and tasks, deals with diverse students, 
and nurtures student academic growth through constructive feedback to ensure they develop a 
strong substance of knowledge and skills. The teacher provides the essential tools and resources 
to help them grow and develop. Although teachers wait patiently and sometimes experience 
struggles and difficulties in planting wisdom and knowledge in students, they experience joy 
and fulfillment when their students reach their full potential. Like water and sun, the teacher 
provides for the needs of the students by accommodating them with equity and not just equality, 
1.e., not just giving equal opportunities and resources to all students but varying support levels 
based on the need to reach a fairer result, acknowledging each has different circumstances, e.g., 
by considering assessing students through observation to be able to give them what they need. 
In time, students will eventually become fruitful trees the teachers have planted (See Table | 
and Figure Ic). 

Table 4 shows that the manifestation of a willingness to participate can still be altered 
when, e.g., pressures triggered by fear and nervousness follow. These cases believably contribute 
to accepting the teacher-as-equity promoter belief. Given the imperative conduct of knowledge 
dispensation and the formation of space for student participation, if there are instances that they 
don't know what to do, the teacher must intentionally guide them. It is vital that teachers are ready 
to accommodate all potential queries of students during class discussions. The teacher must be 
prepared to move and provide for students needing individual support, guidance, or extra help. 
Teachers need to see the whole picture as composed of diverse students with different needs. 
While the students are being cooperative by participating in the discussion, it is crucial that the 
teacher is aware of how the students can understand the idea easily, i.e., they must be ready to 
clarify students' confusion in a more detailed manner when necessary. In this belief [in students' 
perspectives], students are assumed to seek help from teachers to address individual needs, i.e., 
answer their queries while the teacher dispenses knowledge when deemed necessary. As an 
expectation [in teachers' perspectives], students are assumed to receive equity from positive, 
patient, and passionate teachers. This theme highlights the significance of addressing the needs 
of the students while dispensing knowledge. 
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Table 4 


Some Responses that Show a Teacher-as-Equity Promoter Belief 


ID 


#28 


#13 


On Teaching- 
Learning Process 


On Hindrances 
to Class/School 
Success 


"It is important as a teacher to discuss and 
explain every single detail of a specific topic 
to a student, especially when it comes to 
mathematics. At first, the teacher will discuss 
the topic and then give examples ... The 
next step is to make the students answer on 
their own. If there are instances that they did 
know what to do, the teacher will guide them 
to the correct answer. Like what we see in the 
drawing, the student wonders and does not 
know how to solve it, the teacher immediately 
guides the student to answer the problem, and 
if the student already learns the process of 
how to solve the problem, that's the time when 
the teacher will give their [recorded] activity in 
order to assess the students’ learnings." 


"If myself is a great help for me to succeed in 
something, it is also a hindrance. | am the type 
of person who wants to try something, to do a 
lot, but | can't because | am always led by fear 
and nervousness. Like in math class, there are 
times that | know the answer, but | can't share 
it. | can't raise my hand to answer because | 
might make a mistake and be judged by others. 
But now, | think | can say that | have improved 
a lot. | gained more courage now to answer 
and share my thoughts with others though 
there is still a slight fear or nervousness, unlike 
in the past." 


"In the drawing, the teacher is likely explaining 
a math concept to the students, possibly 
using visual aids or examples to help them 
understand. The students actively listen, 
take notes, ask questions, and clarify their 
understanding when necessary. The teacher 
may also be walking around the classroom, 
providing individual support and guidance to 
students who need extra help ... The goal is to 
provide students with the knowledge and skills 
they need to succeed in math and help them 
develop a deep understanding of mathematical 
concepts they can apply to the real world." 


"Overall, I've learned that success in school 
requires effort, commitment, and self-discipline, 
and addressing these hindrances is essential to 
achieving my goals ... | try my best to participate 
actively in class, ask questions, and take notes 
to ensure that | understand the concepts 
being taught. Building positive relationships 
with my teachers has been very beneficial for 
me. Collaborating with my classmates has 
also been helpful in my academic journey ... 
Studying with classmates allows me to learn 
from others and gain different perspectives on 
the material." 


As a mathematics teacher, the teaching-learning process involves assessing prior knowledge, 
setting clear objectives, using various instructional strategies, assessing students’ understanding, and 
providing feedback. The goal is to facilitate student engagement, participation, and learning in a positive 
and supportive environment. The teacher also adopts the teaching approach to meet the needs of the 
diverse learners ... provides resources and support to help students achieve their learning goals. (ID#3) 


Teacher-as-Strategic Scaffolder Belief 


From the fourth main theme, i.e., strategic scaffolder, preservice teachers holding 
student-centered beliefs viewed the teacher as a strategic scaffolder of learning, facilitating 
student learning and advocating student metacognition. Even though there are a lot of sources of 
information online, teachers, as puzzle solvers, fix and put away the student misconception. With 
this belief, students are responsible for their own learning, and both teachers, as coparticipants in 
the discussion, and students attempt to scaffold disconnected information, building ideas from 
it. Like an artist's materials, the teacher allows students to achieve their goals via scaffolding. 
Students are free to explore and swim in the vast area of education like a fish in open water. 
Like a lighthouse in a stormy sea, teachers serve as guides toward the safe harbor of knowledge 
and lead students in proper navigating through the rough waters of education. This indicates 
that teachers are believed to be advocates of metacognition. With patience and in the right 
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conditions, not pressuring them to bloom, students will emerge from their cocoons as beautiful 
and confident butterflies, ready to take flight and face the reality of the world. Like a torch, the 
teachers distinguish themselves to guide others. Being a good teacher is quite challenging, as 
teaching entails assisting students in discovering the mysteries of the world. The role of the 
teachers extends beyond merely imparting knowledge (See Table | and Figure 1d). 

Table 5 shows that the lack of will, drive to succeed, and lack of diligence believably 
contribute to accepting the teacher-as-strategic scaffolder belief. As a strategic scaffolder, the 
teacher inspires, motivates, supports, and, ultimately, educates students. This belief not just 
highlights the significance of addressing the needs of the students while dispensing knowledge 
by keeping an eye out for the warning indications of student troubles and concerns, but teachers 
allow students to discover things on their own from substantial learning opportunities. Teachers 
let students combine all the information and experiences to create and verify new knowledge 
and skills, trying to connect all disconnected concepts from the mind of the students, advocating 
metacognition. Teachers allow the students to develop the ability to make sound judgments. 
Teachers [possibly peers] provide temporary support like a scaffold, are sensitive to the strengths 
and weaknesses of students, and align with the learning intentions and given tasks. It assumes 
students learn more when working together with others who have a broader range of knowledge 
and skills than the student now does, i.e., it can be the teachers themselves or their peers. In 
this belief [in students' perspectives], students are free to express what they want, as errors and 
failures are not seen as hindrances but rather as a gateway and a scaffold to reaching next-level 
learning opportunities. As an expectation [in teachers’ perspectives], students are assumed to 
be diligent in exploring unfamiliar things, learning in their own way, and maximizing learning 
opportunities, as each student is seen as unique and capable of learning. This theme highlights 
combining, extending, and maximizing all knowledge, experiences, and learning opportunities 
to align with and attain learning objectives. 


Table 5 
Some Responses that Show Teacher-as-Strategic Scaffolder Belief 


ID #17 #22 


On Teaching- "In the teaching and learning process, both "When students are free to express what they 
Learning Process _ the teacher and the student play important want, this is a conducive classroom. Letting 

roles. A teacher's job is to inspire, motivate, them learn in their own way because every child 

support, and educate students. They establish is unique." 

and create a welcoming environment, 

mentor and care for students, serve as role 

models, listen, and keep an eye for warning 

indications of problems. Students’ roles are to 

learn the material being taught to them and, 

more crucially, discover methods to apply it 

outside the classroom ... Learning is a lifelong 

process that involves converting knowledge 

and skills from information and experience ... 

We develop the ability to assess information 

and make judgments based on it." 


On Hindrances "Lack of will to succeed] is a significant "Not every time I'm diligent because [there 

to Class/School obstacle for me because | frequently perform are times that] bad habits are visiting me ... 

Success the bare minimum amount of work in the They say that being diligent [masipag] is more 
classroom ... A lack of drive can frequently essential than being wise [mahusay] ... So being 
lead me learning merely for the sake of it. diligent will get you into anything." 
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Learning for me is the process of gaining insights, abilities, attitudes, or behaviors through a 
combination of practical experiences, academic study, or guidance ... A student is like a butterfly in a 
cocoon because they are still undergoing a transformational journey of growth and development. With 
time, patience, and in the right conditions, not pressured to bloom, they will emerge from their cocoon as 
beautiful and confident butterflies, ready to take flight and face the reality of the world. (ID#2) 


Figure 1 
Sample Drawings from the Drawing Task 
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Discussion 


Based on the study's results, teacher-centered beliefs referred to the metaphors, drawings, 
and unstructured data responses that implied teachers were knowledge dispensers; mixed beliefs 
indicated teachers were reliable improvers and equity promoters, leading classroom actions and 
students as active participants, although limited in learning processes; and student-centered 
beliefs implied teachers were strategic scaffolders. The teacher belief patterns are organized 
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into several themes. From the first theme, the teacher-as-knowledge dispenser belief, preservice 
teachers holding teacher-centered beliefs viewed the teacher as a dispenser of knowledge that 
fills young minds with concepts they need to learn. In this belief, students give their trust and 
confidence in acquiring and developing learning to substantially competent teachers. As an 
expectation, students are assumed to obtain all the required information teachers would like 
to dispense. As stated by Ihedioha (2012) in her paper titled "Effectiveness of Transmitter of 
Knowledge and Conventional Teaching Models on Secondary School Students' Achievement 
on Circle Geometry and Trigonometry," 


Teaching, as conventionally understood by a [traditional] teacher, is the act of disseminating 
information to the learner in the classroom. If we observe traditional classroom teaching, we find that 
either the teacher is delivering information or one of the students is reading from the textbook, and other 
students are silently following him in their own textbooks. [Conventional] teaching is simply chalk-talk 
approach in which students remain passive learners ... Transmitter of knowledge model emphasizes the 
need to give pupils basic facts and information before they can be expected to think for themselves. They 
must learn what is already known before they can come up with any new ideas that might fit in with the 
existing knowledge. The main characteristic of this model is the high degree of structure employed ... 
In short, the teacher views that it is the teacher that causes learning to occur, and classroom discipline is 
based upon fear (pp. 36-39). 


From the second theme, the teacher-as-reliable improver belief, preservice teachers 
with mixed teacher-centered and student-centered beliefs viewed a teacher as a dependable 
improver shaping, molding, and honing students to become successful society members. In 
this belief, students are assumed to explore and construct knowledge and later be improved 
and refined through participation after the teacher has dispensed necessary information. As 
an expectation, students are supposed to improve as teachers become reliable and consistent 
in safeguarding student participation. As said by Ing et al. (2015) in their research paper titled 
"Student Participation in Elementary Mathematics Classrooms: The Missing Link between 
Teacher Practices and Student Achievement" 


First, student participation positively predicted student achievement. The more actively students 
participated, by explaining their own thinking and engaging with the ideas of other students, the higher 
were their achievement scores. Second, teacher support of student participation (TSSP) positively 
predicted student participation. The more frequently teachers supported students' participation, the higher 
were students! levels of participation. More specifically, the extent of TSSP directed to a specific student 
was related to the level of participation of that particular student. Third, the link between TSSP and 
student achievement is best understood as an indirect relationship through the mediating effect of student 
participation. Rather than impacting student achievement outcomes directly, TSSP was related to student 
participation which, in turn, was related to student achievement (p. 353). 


From the third theme, the teacher-as-equity promoter belief, preservice teachers holding 
mixed teacher-centered and student-centered beliefs viewed the teacher as a promoter of equity 
by being patient and persistent. In this belief, students are assumed to seek help from teachers to 
address individual needs and answer their queries while dispensing knowledge when necessary. 
As an expectation, students are assumed to receive equity from positive, patient, and passionate 
teachers. As mentioned by Zevenbergen and Ortiz-Franco (2002) in their editorial titled "Equity 
and Mathematics Education" on the significance of addressing the needs of students, 


Some students do not have the same access, success, participation, or retention in mathematics 
as some of their peers ... The practices of mathematics education come under scrutiny in terms of how 
they are implicated in the construction of different outcomes for different students. Thus, mathematics 
education is seen to be a 'political' act through which some students are more likely to be seen as successes 
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and others not. By better understanding how [hegemonic] practices work to support particular ideologies of 
mathematics teaching and learning, the mathematics education community is better positioned to develop 
practices that are more inclusive. By shifting the focus of analysis to social practices in terms of how 
these are implicated in the construction of different outcomes for learners of mathematics, mathematics 
educators are better able to understand and develop more socially-inclusive practices (p. 151). 


From the fourth theme, the teacher-as-strategic scaffolder belief, preservice teachers 
holding student-centered beliefs viewed the teacher as a strategic scaffolder of learning, 
facilitating student learning and advocating student metacognition. In this belief, students are 
free to express what they want, as errors and failures are not seen as hindrances but as gateways 
and scaffolds to reaching next-level learning opportunities. As an expectation, students are 
assumed to be diligent in exploring unfamiliar things, learning in their own way, and maximizing 
learning opportunities, as each student is seen as unique and capable of learning. As mentioned 
by Anghileri (2006) in her manuscript titled "Scaffolding Practices that Enhance Mathematics 
Learning," 


Mathematics teaching is informed by the social constructivist paradigm for the teaching—learning 
process in which students actively construct meaning as they participate in increasingly substantial ways 
in the re-enactment of established mathematical practices. Marked changes from traditional teaching 
approaches are needed as the role of the teacher changes from 'showing and telling' to responsive 
guidance in developing pupils’ own thinking. This guidance requires a range of support for pupils’ 
thought constructions, in a way that develops individual thinking as well as leading to the generation 
of mathematically valid understandings ... The notion of scaffolding also presupposes that learning is 
hierarchical and built on firm foundations (pp. 33-47). 


Accommodating student participation and addressing student needs did not directly 
indicate outright student-centeredness. SCL demands the sharing of control from the teacher 
to the students, allowing them to operate on their own, enabling them to manage their own 
learning, and intentionally interconnect situations, experiences, and their prior knowledge in 
the construction of new knowledge through appropriate scaffolds and/or methodology until 
they reach the intended learning outcomes. For a visual account, based on the conceptualized 
teacher belief patterns organized through themes, a representation of educational beliefs of 
preservice Filipino mathematics teachers is presented (See Figure 2). 


Figure 2 
A Visual Representation of Preservice Filipino Mathematics Teachers’ Educational Beliefs 
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Conclusion and Implications 


The first theme, teacher-as-knowledge dispenser belief, features the imperative conduct 
of the dispensation of knowledge; the second theme, teacher-as-reliable improver, highlights 
the formation of space for student participation after dispensing knowledge; the third theme, 
teacher-as-equity promoter belief, highlights the significance of addressing the needs of the 
students while dispensing knowledge; and the last theme, teacher-as-strategic scaffolder belief, 
highlights combining, extending, and maximizing all knowledge, experiences, and learning 
opportunities to align with and attain learning objectives. This emphasizes that the teacher-as- 
knowledge dispenser belief in mathematics teaching is more teacher-centered, the teacher-as- 
reliable improver and teacher-as-equity promoter beliefs in mathematics teaching are mixed, and 
the teacher-as-strategic scaffolder belief in mathematics teaching is more student-centered. It 
has been found and established in this research that focusing on the structure of accommodation 
for student participation as well as addressing the needs of the students did not imply outright 
student-centeredness. Student-centeredness requires the sharing of control from the teacher to 
the students, allowing them to operate on their own via scaffolds until they reach the intended 
learning outcomes or objectives. This study has some limitations. First, it only considered a 
small sample size, and second, the research locale of the study was within the Philippines. 
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Abstract 


A computer science camp for pre-collegiate students was operated during the summers of 2022 and 2023. 
The effect the camp had on attitudes was quantitatively assessed using a survey instrument. However, 
enrollment at the summer camp was small, which meant the well-known Pearson's Chi-Squared to measure 
the significance of results was not applied. Thus, a quantitative analysis method using a multinomial 
probability distribution as a model of a multilevel Likert scale survey was used. Exact calculations of a 
multinomial probability model with likelihood ratio were performed to quantitatively analyze the results 
of questionnaires administered to participants in two cohort groups (combined N=17). Probabilities per 
Likert categories were determined from the data itself using Bayes theorem with a Dirichlet prior. Each 
cohort functioned as part of a homogenous sample, thus allowing cohorts to be pooled. Post-test revealed 
significant changes in participants ‘attitudes after camp completion. Using this technique has implications 
for studies with small sample sizes. Using exact calculation of the multinomial probability model with 
the use of likelihood ratio as a statistical test of evidence has advantages: a) it is an exact value that 
can be used on any size sample, although it offers a quantitative analysis option for small sample size 
studies; b) depends only on what was observed during a study; c) does not require advanced calculation; 
d) modern spreadsheet and statistical package programs can calculate the analysis; and e) likelihood 
ratio employed in Bayes theorem can update prior beliefs according to evidence. Utilizing small sample 
size quantitative analysis can strengthen insights into data trends and showcase the importance of this 
quantitative technique. 

Keywords: multinomial probability model, likelihood ratio, small sample study, survey research, 
quantitative analysis, summer camp 


Introduction 


Researchers engaged in educational experiments or in other settings, such as innovative 
classrooms or informal learning camps, would often like to assess the effectiveness of their 
efforts. One assessment strategy is to use a paired pre-/post-activity survey. However, acommon 
issue encountered is that the camp or classroom involves a small sample of participants. The 
common method of measuring significant differences from pre- to post-activity is through 
Pearson’s Chi-Square. However, this test of significant difference requires a sample size often 
larger than a camp or classroom provides. Thus, some other method is needed. 

The problems that small sample studies present are not unusual in educational research 
involving educational activities (Boddy, 2016; Delice, 2010; Fugard & Potts, 2015). In self- 
contained classrooms, the average class size in U.S. public middle schools and high schools is 
slightly under seventeen (NCES, n.d.). Thus, if a typical class were to be used as a cohort in a 
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study it would be a small-numbers cohort. While the number of studies documenting a positive 
influence of class size on student performance is small, and any conclusions drawn from them 
are tentative, there is likely to be continued pressure for reduced class size in the future by 
reason of this being among common-sense ideas (Chingos & Whitehorst, 2011). Similarly, 
more intensive learning activities like camps are size constrained for many reasons, including 
but not limited to staff-to-students ratio requirements. They may involve small-numbers cohorts 
(Talafian et al., 2019). Thus, an examination of statistical tools for analyzing small-numbers 
cohorts may be useful. 


Research Problem 


Measuring the effectiveness of summer camps with school-aged children is often done 
through survey research of camp participants answering prompts by way of a Likert Scale, 
the results of which are analyzed quantitatively (Baek & Touati, 2020; Cheng et al., 2021; 
Chou, 2020; Fiorella et al., 2019). A Chi-Squared analysis approach is generally considered 
appropriate if done with a sample size (NV) greater than 25. However, many summer camps 
have fewer than 25 participants, or researchers would like to compare groups containing fewer 
than 25 individuals (Talafian et al., 2019). Thus, a problem exists of how to analyze groups of 
fewer than 25 quantitatively. The research team in this study engaged with two years of summer 
camps in 2022 and 2023. Predicting that not enough participants would enroll in camp to justify 
using Pearson’s Chi-Squared, novel methods were considered early. 


Research Focus 


In early 2022, a cryptocurrency exchange and bank based in the United States approached 
the university where this study took place through its not-for-profit Foundation to offer a gift in 
support of a variety of educational and research initiatives. A portion of the funds were earmarked 
to support engaging camp-like educational activities pertaining to a broader set of topics and 
technology related to cryptocurrency for pre-collegiate children ages 10-14, henceforth referred 
to as campers. Based on the initial suggestion to expose campers to the central technology that 
enabled cryptocurrency, the camp focused on distributed trust, foundations of encoding and 
transforming information, and ultimately blockchain structures. 

The camps were designed to use an unplugged approach of developing computational 
thinking implicitly rather than programming skills. Both years of camp were facilitated by 
graduate students in computer science and assisted by undergraduates majoring in computer 
science. The unplugged activities consisted of several games and puzzles which indirectly 
taught concepts of consensus, trust, chains, and blocks. Unplugged activities appeared to have 
captured the attention of the campers because there was little attrition throughout the week-long 
course. However, the course was under-subscribed with only about one-half of the planned 
enrollment of 20. From those ten campers, nine were able to complete both pre and post 
questionnaires. The camp was funded again during the summer of 2023, and eight campers 
participated in the 2023 cohort. 

Because summer camp is an informal learning activity, assessments and other content 
knowledge tests were avoided. Moreover, at the time of camp, this study took place in a state 
that had just adopted standards for middle and high school computer science for the 22-23 
school year, so benchmarks to measure content knowledge learning gains were not readily 
available (Northrup & Burrows Borowczak, 2023). Thus, it was decided to measure attitude 
(affect) towards computer science and to measure a 21“ Century skill of teamwork, composed 
of trust and consensus building of campers in small groups. 
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Research Aim and Research Questions 


The purpose of this study was to examine a quantitative analysis approach of participants’ 
responses to questionnaire prompts in a group of fewer than 25 participants. To fulfill this 
purpose, the following research question was pursued: how might a multinomial probability 
model be used to quantitatively analyze a small group (J), e.g., participants in a summer 
computer science camp? 


Research Methodology 
General Background 


For the past several years, people have noted a need for informal education about science, 
technology, engineering, and mathematics (commonly called STEM), especially computer 
science and computer engineering (NRC, 2015). Many educators have offered summer camps 
for school-aged children as one way to meet this need (Cui & Ng, 2021). Informal education 
by way of summer camps geared towards school-aged children has been used for more than 
a decade to raise awareness of computer science, engineering, and other STEM disciplines 
(Decker & McGill, 2019). 

Summer camps often have the purpose to raise awareness in children about programming 
through robotics (Amo et al., 2021; Anwar et al., 2019; Darmawansah et al., 2023) or about 
computational thinking through subtler means such as unplugged activities (Chen et al., 
2023). In addition to discipline-specific knowledge and skills, broader 21“ Century Skills 
such as communication and collaboration have been integrated into STEM camp, as well as 
foundational skills common to multiple disciplines, such as computational thinking (Kim et al., 
2019; Wiebe et al., 2020; Wing, 2006). Camp objectives may articulate computational thinking 
skills explicitly by way of programming activities, e.g., robotics (Yilmaz Ince & Koc, 2021). 
There is also an implicit approach, that of unplugged activities (Delal & Oner, 2020; Zapata- 
Ros, 2019), which may integrate with other STEM disciplines and take a truly integrated 
disciplinary approach. 

The effectiveness of informal summer camps may be measured qualitatively or 
quantitatively. Learning gains, interest, attitude, motivation, and other effects have been 
measured in campers (Decker & McGill, 2019; Hammack et al., 2015; Kong et al., 2014) 
using interviews, field note observations, and other methods that yield qualitative, interpretive 
results and usually describe a process of change. On the other hand, researchers may choose to 
quantify or quantitatively analyze the overall change from the impact of the camp experience 
itself, which is typically done by a pretest of initial status, followed by the camp experience 
(treatment), followed by a posttest. The pre-and post- are examined for meaningful change in 
participants, as evidenced through their responses. One of the tools often used in evaluations of 
educational methods is a questionnaire, either a previously developed instrument or one created 
for the camp, typically consisting of a small number of categories to choose from, like the 3- 
or 5-point Likert scale example described in more detail in later sections. Responses from the 
questionnaires are analyzed quantitatively to measure change from pre- to post-, and whether 
the change was meaningful (e.g., statistically significant) to support the claim that the treatment 
(e.g., camp) was effective. 


Pearson's Chi-Squared Model 


Specifically, the goal of pre/post survey quantitative analysis is to determine whether the 
observed numbers in each category of the Likert scale survey before the treatment is applied 
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(the class lesson or the camp activity) are or are not significantly different from the observed 
numbers afterward. This is an exercise in statistical inference. The most common method of 
statistical inference relies on the value of one or more statistics, generated by an experiment, as 
a measure of evidence. One such statistic is Pearson’s Chi-squared, which is commonly used 
for survey research. It is simple to calculate, and its significance levels are widely available in 
table form. 

Many textbooks written from 1950 to 2015 aimed at teachers or education researchers 
suggested tools for categorical data testing, such as counts per category of a Likert scale. The 
textbooks frequently took one of three approaches. First, textbooks meant to examine the 
operational aspects of testing and measurement in the classroom, administering quizzes, tests, 
and assignments did not include sections on statistical analysis. Even though the textbooks may 
have had the word measurement in the title, they lacked mention of quantitative analysis methods. 
Many did not use the word statistics at all. Other textbooks took an introductory approach 
intended to explain the most basic aspects of descriptive statistics to the working teacher. The 
textbooks were generally written from pre-1970 to 2009. The quantitative analysis techniques 
concentrated on the bell curve, the standardized Z statistic, its distribution, and so forth. The 
Chi-Squared statistic was mentioned in a cursory manner, if at all. Finally, some textbooks 
took a modeling approach, described as making future predictions based on the observations 
issuing from an educational treatment, e.g., a class lesson or a camp activity. Modeling requires 
advanced statistical tools such as least sequence regression or logistic regression that are 
beyond introductory textbooks in statistical inference. Thus, teachers and education researchers 
may consider taking a modeling approach as beyond the scope of evaluating various aspects of 
camp, including overall effectiveness. 

The focus of many graduate level education research textbooks was to teach the use 
of statistics using a software package such as SPSS and applying this to numerous examples 
(Field, 2013). Avoiding the phrase statistical inference, the textbook instead discusses 
statistical significance, which Field defined as a process that is a blend of Ronald Fisher’s idea 
of computing probability to assign weight of evidence with the Neyman-Pearson weighing 
of competing hypotheses (Field, 2013). Other textbooks used concepts such as confidence 
intervals, p-values, or significance levels. 

Only a few education research textbooks identified the multi-category Likert as an 
instance of a multinomial distribution. The only simple statistical test, other than modeling, 
suggested for testing multinomial distributions is Pearson’s Chi-Squared in a goodness of fit 
mode. The usual path recommended in education research textbooks to follow is thus: 


1; Decide on a sampling statistic; Pearson’s Chi-Squared in this case. 

2: Somehow determine a set of probabilities per category that define the null hypothesis: 
(p,€ (0,1); i= 1...k; X31). These may be available from some theoretical consideration 
or from the before treatment survey itself. 

3. From everything known a priori, decide on a level of significance for the test of the 


after-treatment survey being not consistent with the null hypothesis. This value of alpha (ay) is 
typically .01 to .05 and describes the fraction of the probability distribution of the test statistic 
equal to a significant event or an event “more extreme”. One might use the 5% level if there is 
already some evidence supporting efficacy. 

4. Calculate the test statistic and decide if it reaches or exceeds the significant value. If it 
does, conclude the treatment having an effect and evidence for rejecting the null hypothesis. If 
it falls short of the significant value, decide instead that there is no evidence to reject the null 
hypothesis that before and after treatments are the same (Meyer, 1970). 
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Limitations of Pearson's Chi-Squared Method 


From the previously mentioned procedure, one might conclude that the Chi-Squared tool 
is appropriate to analyze or test Likert survey results scientifically. There are some complications 
to taking the Chi-Squared approach, however. First, a distinction needs to be drawn between 


Chi-Squared, which is a family of probability distributions depending on two parameters ( la 


and B) and for which probability versus deviation can be calculated exactly, and Pearson’s 
Chi-Squared, which is the sampling statistic in play. Pearson’s Chi-Squared is a calculation 
from observations. Chi-Squared is a theoretical distribution that can be found in a table. They 
become one and the same with a large enough sample size. Pearson’s Chi-Squared is defined as 


D*= pe (O, - E,)’/E,; where O, is the observed number of responses per Likert category (i runs 
from | to 5 in a typical case) and E; is the expected number from the null hypothesis. How to 
determine E, is set aside until further in the article when an example is shown. 

As scholars describe the situation, the true probability distribution of D? is very 
complicated, but when the number of observations (NV) becomes large enough, the continuous 
Chi-Squared distribution provides a good approximation for D? (Meyer, 1970; Papoulis, 1990; 
Snedecor & Cochran, 1967). The usual advice on this matter is that if the expected frequency 
per category is at least 5 for all categories, then Chi-Squared is an adequate approximation. This 
advice is legion, nearly a tradition, and the advice appears to refer directly or indirectly to a 
1952 paper by W.G. Cochran. What Cochran had to say on this matter is not so simple. 

Cochran explained that the rule of thumb at the time was 5 or maybe even 10, but these 
values were pulled from a hat as it were. He then set out to “appraise the performance of the tabular 
approximation in the borderline region between statistical significance and non-significance” 
(Cochran, 1952, p. 328). That is, he set out to determine the disturbance or departure between 
the true distribution of D? and a table of Chi-Squared values used for convenience. As he stated, 
“A disturbance is regarded as unimportant if when the P is 0.05 in the Chi-Squared table, the 
exact P lies between 0.04 and 0.06, ...” (Cochran, 1952, p. 328). One can see a difficulty with 
the Chi-Squared approach immediately. Suppose one sets a 5% significance level ahead of 
time, as statistics books instruct, and subsequently finds a Chi-Squared approximation for D* 
near 4%. This person now rejects the null hypothesis and publishes the statistically significant 
results. Later, someone else fetches data from the supplementary materials for this paper and 
using an exact calculation for the multinomial distribution, or a Monte Carlo calculation, they 
find the actual value of D*? is undoubtedly 6%, thus establishing an inconsistency with the 
interpretation of the data. A full reading of Cochran’s paper reveals that the circumstances 
under which a table of Chi-Squared can substitute for a knowledge of the true percentile of D? 
is complex and depends on several parameter values and factors, not just the sample size. 


Multinomial Probability Model 


The multinomial probability distribution makes a reasonable model of analyzing a 
questionnaire with Likert scale responses. It is a joint probability distribution with as many 
variables as there are response categories. It is a generalization of the binomial model for sets 
of two-choice outcomes such as pass/fail, yes/no, and so forth, but allows for more than two 
outcomes. The Likert scale responses in this study involved five possible outcomes. Each 
possible outcome is, itself, a binomial process. For example, the extreme category completely 
true of me is seen as a binomial outcome when paired against its alternative /ess than completely 
true of me. 

In the simplest possible view, regard a participant responding to a question as an 
extension of a Bernoulli trial, an extension resulting in a count for one of k categories rather 
than a dichotomous outcome like pass/fail. Let x,,...,x, be the observed counts per category in a 
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questionnaire, and p.,...,p, as the associated fixed probability of each. Then, the probability that 
N respondents result in data of (x,,...,x,) is: 


N! 
PO KX IP Pye (a p, *p, ee is K 


While each participant may choose independently and may choose any of the k options 
for any reason at all, or no reason, without the intervention of the treatment it is assumed they 
would choose consistently. There are potential problems with this assumption. Participants 
may conspire to choose similarly, thus hampering independence, and they may choose two 
options, or skip the question completely, or even supply a hand-written fractional choice. These 
censored responses can be dealt with in a variety of ways, such as deleting incomplete records 
entirely, imputing values, or predicting what the censored values would likely be (Edwards, 
1992). 

While the multinomial is a generalized binomial distribution, more insight is gained by 
viewing it as a collection of k Poisson processes each with its own rate p, of being chosen in 
each trial. This provides a simple explanation about the relationship of Pearson’s Chi-Squared 


to the Chi-Squared distribution. After N trials the kth category is expected to have lu, = Np,- 
If N is large enough, then the difference (x,y) follows a normal distribution. The variance 


of the Poisson distribution is Np, itself. Thus (x,4)?U, follows a Chi-Squared distribution 
if N is large enough. According to Engels (n.d.), however, NV is often not large enough, or the 
circumstances under which N is large enough to depend on more than just N (Cochran, 1952; 
Taroni et al., 2010). What would work better is to have a robust test method for small N. 


Likelihood 


Having chosen a probability model, a random process, to analyze responses to a 
questionnaire with Likert scale responses, a statistic drawn from it to use for significance testing 
is needed. Likelihood is a conditional probability, P(A|H); the probability that proposition A 
is true given the conditions in the hypothesis being tested, H. The conditions making up H 
are the probabilities of an individual respondent choosing each of the Likert scale categories. 
Likelihood differs from probability in the sense that probability focuses on the probability of A 
conditioned upon the truth of H, whereas likelihood focuses on the observation A as evidence 
for the hypothesis H (Royall, 1997). One does not use P(A|H) directly as evidence, but rather 
the ratio of this conditional probability as applied to two different propositions A, the probability 
of the observed frequency of responses per category after treatment and B, the probability of 
the observed frequency of responses before. One may also use the logarithm of the Likelihood 
Ratio (LLR). 

An attractive aspect of the likelihood ratio as a measure of evidence is that it depends 
only on what was observed or measured during an experiment or study. Royall (1997) presented 
a strong case for likelihood ratio being the only logical and consistent measure of evidence 
among any of the competitive measures such as p-value, confidence intervals, significance 
level, and so forth. In the case of this study, it is additionally attractive that likelihood may be 
calculated exactly from the multinomial distribution for arbitrarily small cohorts. 


Sample 
In 2022, ten campers participated in camp, and nine were able to complete both pre- 


and post- questionnaires. The camp was funded again during the summer of 2023, and eight 
campers participated and completed both pre- and post-questionnaires. Thus, N = 9 in 2022, N 
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= 8 in 2023, and total for both years of camp N = 17. Attitude (affect) towards computer science 
and a 21* Century skill of teamwork, composed of trust and consensus building of campers in 
small groups, were measured through administering two questionnaires. The questionnaires 
were intended to measure high interaction in small groups and an appreciation for blockchain 
technology and computational thinking within the umbrella of computer science discipline 
(Kim et al., 2019; Wiebe et al., 2020). The research was approved by the Institutional Review 
Board. Campers provided assent and parents/guardians provided consent for the study. A pre/ 
post approach was used to measure each issue and quantitatively analyze if notable change had 
occurred. 


Instrument and Procedures 


Two questionnaires were administered to campers, both measuring the effect and both 
administered on the first hour of the first day of camp (pre-test) and on the last hour of the 
last day of camp (post-test). The questionnaires were used with permission and were designed 
for a middle school audience (Cantrell & Andrews, 2002; Rachmatullah et al., 2020). One 
questionnaire measured attitude towards computer science in a series of 12 questions with 
5-scale Likert responses from strongly disagree to strongly agree including a neutral point 
(Rachmatullah et al., 2020). The other questionnaire focused on the camper’s opinions toward 
group work. It posed 30 questions in five categories with 5-point Likert responses from not at 
all true of me to very true of me with a neutral point (Cantrell & Andrews, 2002). 


Data Analysis 


Campers completed the questionnaires. Each pre- and post-test were paired. The non- 
paired questionnaires were removed from the data analysis. Because of the low number of 
campers and correspondingly low number of paired tests (NV), the analysis of the questionnaires 
was complicated by two problems. First, some categories in the questionnaire were empty — 
they contained zero response. Second, even when some categories were not empty, all the 
categories fell far short of the rule of thumb for using Chi-Squared to test the uniformity of 
pre/post responses. This caused a search for alternatives to Chi-Squared. It was determined 
the solution lay in considering alternatives to the Chi-Squared approach, namely using exact 
calculations of the multinomial probability model. 


Research Results 


A question from the Feelings Toward Group Work (GW) survey used in this study 
provides an example of using statistical reasoning to arrive at conclusions when the cohort is 
too small to use Chi-Squared. 

GW27: “T rarely feel relaxed within a group.” 

First, one must establish the assumptions in which the inference is conditioned. There is 
some reason for believing that the treatment, e.g., the camp experience, will have some effect 
on responses to this question from pre to post. Assume that there is no difference between Jack, 
who chooses response 3 and Jill who chooses 4. They are both simply trials that result in a count 
in one of the survey categories according to a probability for that category (p,); assume that 
before the treatment each of the responses has some probability of being chosen and while it is 
unknown what these probabilities are (they will be estimated from the observations), assume 
that in the absence of the treatment (camp), these would remain fixed. The counts themselves 
are a sample which could change from one group of respondents to another, i.e., the counts are 
random variables. 
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Next, estimate the probabilities of students choosing one or another of the five Likert 
categories per question. The obvious path is to use the before treatment response frequencies 
themselves as these probabilities. However, this leads to the possibility of a zero count in one 
or more categories leading to a zero probability; an issue made more acute with small cohort 
numbers. 

A Bayesian approach was used to update probability with observations. An uninformative 
prior guess as to the probabilities is a guess that quickly fades into irrelevance with increasing new 
information from the pretreatment survey. The Dirichlet distribution provides an uninformative 
prior. It consists of a frequency per category of a uniform value of one (Johnson & Christensen, 
2012). The value is updated with observed frequencies from the pretreatment survey. The 
probability found per category (1) is p, = (1+f,)/(k+N) where fis the frequency of response in the 
i" category, k is the number of categories, and N is the total number of respondents. Probability 
so found produces a maximum likelihood close to the observed frequencies and solves the 
problem of avoiding zero probability. 

Table 1 shows the data collected as pretreatment during summer camp for this statement 
in 2022 and 2023. The per category probabilities based on 2022 responses alone, and then 
on pooled responses for both years are included. Finally, the likelihood ratios of year 2023 
responses based on either set of estimated probabilities are shown in the final row. The LR 
values outside the range of the null hypothesis (’4 to 8) would be representative of strong 
evidence of a difference. Any LR values falling within this range are too weak to reject the null 
hypothesis that the year 2022 and year 2023 responses are the same. Note in Table | that neither 
estimated probability results in an LR smaller than or equal to ’s nor larger than or equal to 8. 
Thus, there is no evidence that the belief of students entering camp in the year 2023 is different 
from those who entered in the year 2022. 


Table 1 
Pretreatment Survey Results Testing Responses to Statement GW27- “I rarely feel relaxed 
within a group.” Comparing Year 2022 to Year 2023. 


alegeny athe Reaponees ee Pad ag greet ara : 
Not at all true of me 1 3 0.143 0.227 
Partly not true of me 3 1 0.286 0.227 
Neutral 3 2 0.286 0.273 
Partly true of me 1 1 0.143 0.136 
Very true of me 1 1 0.143 0.136 
LR (2022/2023) N/A N/A 2.6 0.819 


What has been established at this point is that there is no evidence of changing pre- 
treatment views of campers between the year 2022 cohort and the 2023 cohort. Thus, it makes 
sense to use pooled data to estimate probabilities. If the pre-treatment views of campers differed 
between years, then there is an indication that the campers are not homogeneous, e.g., they 
may have participated in an event that altered their initial perceptions about group work and 
computer science. 

Using pooled estimates of P. analysis proceeded to examine evidence for or against 
the proposition GW27 having changed pre- to post-treatment. Table 2 shows the results. The 
probabilities in the far-right column are calculated using the pretreatment frequencies and result 
in the LR of 12.1. The LR value of 12.1 shows strong evidence that post-treatment frequencies 
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are very unlikely to arise from the null hypothesis; that is, shows strong evidence that the 
treatment has altered the categories to be more heavily weighted toward categories 3, 4 and S. 
After having engaged in the camp activities, participants perceive themselves as less relaxed 
within a group. 


Table 2 
Pooled (2022+2023) Frequencies Before and After Treatment. 


Pooled Pooled Post P, using pooled 

Category Pre-treatment treatment frequencies 

Responses Responses pretreatment 
Not at all true of me 4 1 0.227 
Partly not true of me 4 4 0.227 
Neutral 5 7 0.273 
Partly true of me 2 1 0.136 
Very true of me 2 4 0.136 
LR (Before/After) N/A NIA 12.1 


It is interesting at this point to calculate how such results should alter one’s beliefs about 
students' view of the treatment (camp). How one should rationally update beliefs based on 
Bayes theorem is: 


pHa) = (7S + pcHy) 


H could stand for either H,, the null hypothesis that the probabilities per category have 
remained at the pretreatment values, or H., the alternative that probabilities have shifted to values 
represented by the posttreatment results. Event A is the observed frequencies posttreatment. 
The total probability of event A, P(A), is composed of only two observations because that is all 
that the study contains. Thus, P(A) = P(AJH,)P(H,)+P(AJH, )P(H, ), and rearranging produces 


P(A|H0)*P (HO) ) _ ( P(A|HO)P(HO) ) 
P(A) P(A|HO)(P(HO)+(P(H1)P(A|H1) 


PHA) ={ 


Assume that one judged a priori even odds that the treatment would have an effect. Thus, 
the a priori belief in the probability of H,, which is to say P(H,), is 50%. But P(AJH,)/P(A|H,)) 
is the LR as calculated in the fourth column of Table 2. And this modifies the a priori belief that 
P(H,)=P(H,)=.5. Thus, in this case: 


0.5 
PCH JA) = Gencer) = 7.6% 


The observation of frequencies posttreatment (event A) has decreased belief in H, from 
50% to 7.6%. It is almost a certainty (92.4%) that the probabilities of the null hypothesis (H,) no 
longer apply after the camp activities. The observation of event A is far more likely (12.1 times 
more likely) with the probabilities of H, than with the probabilities of H,. 


Discussion 


The ability to quantify differences using likelihood ratio applied to the multinomial 
distribution, enabled one to make a few determinations about year 2022 and 2023 camp 
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experiences. First, regarding pre-camp attitudes toward group work, the 2022 and 2023 cohorts 
looked to have come from a homogenous group with no significant differences between them. 
This made it possible to combine the two into a larger group for analysis, which improved the 
resolution of pre-camp to post-camp changes. Regarding attitudes toward computer science, the 
second of the two questionnaire surveys, the only significant differences pre-camp appeared to 
be related to females, being more numerous in the 2023 cohort, also being somewhat less sure 
initially about the usefulness of computer science to their future careers. 

Second, quantitative results substantiated only a few significant changes in student 
attitudes regarding group work or computer science pre-camp to post-camp. Specifically, by 
the end of camp, campers felt more neutral to negative about comfort working in a group, and 
communicating with other group members, from their perceived comfort pre-camp. Campers 
felt less positive about enjoying group work and its effectiveness. The responses to these items 
indicate a tempering of views that group work runs smoothly and that all members contribute. 

Of the nine-item questionnaire, two items showed differences between 2022 and 2023 
regarding initial attitudes toward computer science. These differences may possibly result from 
female campers being more reserved about their programming abilities at the beginning of 
camp. Campers may also be more cautious about the usefulness of programming for their future 
work pre-camp. 

The results of the pooled responses from campers pre- to post- in 2022 and 2023 showed 
a change in campers’ attitudes toward computer science regarding one item. The item stated / 
would like to use creativity and innovation in my future. The change in attitude to somewhat 
true of me or very true of me may pertain to activities done in camp that emphasized creativity. 

Taking a step back to reflect on using an alternative approach to quantitative data 
analysis, the authors suggest that using this approach strengthened the conclusions that 
campers tempered their initially high enthusiasm with the realism of challenges associated with 
computer programming and teamwork skills. Such insights may not have had the support if 
purely qualitative evidence had been used such as field note observations, or they may not have 
been noted at all. From the authors’ viewpoint, adding the quantitative analysis helped steer 
overall impressions of camp toward pinpointing how future camps emphasizing group work 
may be better structured. Overall, quantitative analysis provided an additional line of evidence 
to help triangulate the otherwise qualitative data. 


Other Exact Methods 


Recognition that the use of Chi-square seems both archaic and limited to large samples 
has led people to suggest alternative exact tests. Fisher’s (1934) exact method, for example, is 
appropriate to 2x2 contingency tables. It is often called the exact calculation of Chi-Squared 
and is based on the hypergeometric probability model of sampling a finite number of objects 
without replacement. It’s mentioned, often only in passing, as a calculation of the Chi-Squared 
test when n is a small number but never in circumstances beyond 2x2 contingency tables or 
independent samples with dichotomous outcomes (Field, 2013; Huck, 2012; Siegrist, 2022). 
However, the existence of more than two categories in the case of a Likert scale produces a 
contingency table larger than 2x2. In this case, an exact calculation of Chi-Squared requires a 
joint distribution generalized from the hypergeometric distribution. 

Other exact methods exist. Basic combinatorial arguments can be used to derive the 
probability density function of the multivariate hypergeometric distribution. Details about 
this distribution are beyond the scope of this article but are available elsewhere (Engels, n.d., 
Siegrist, 2022). 

Engels (n.d.), in another example of using exact methods, outlined two alternative exact 
tests, one of which is the log likelihood ratio without a particular null hypothesis in mind, 
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the other being just the multinomial probability itself. Both can be calculated from routines 
available in the statistical package R. Resin (2023) illustrated an algorithm for exact multinomial 
calculation equivalent to the significance tests such as significance level, confidence intervals 
and so forth which uses an algorithm implemented in the package R and delivers a probability 
equal to the observed frequency counts and observations that would be more extreme were they 
to be observed. Some scholars mention using the log likelihood ratio (Resin, 2023). This is not 
an alternative analysis method but simply another way to measure the likelihood ratio. 


Conclusions and Implications 


Differences between pre-camp and post-camp surveys were analyzed using a 5-level 
Likert scale questionnaire modeled with a multinomial distribution and a likelihood ratio 
statistic. The comparison of a pre-camp survey to a post-camp survey revealed significant 
changes in campers’ attitudes after completion of camp. This provided quantitative measures of 
significant changes in response in a setting where the more well-known Pearson’s Chi-Squared 
could not be used because of the small sample size. 

Using an exact calculation of the multinomial probability model with the use of likelihood 
ratio (LR) as a statistical test of the strength of evidence has numerous advantages. It is an 
exact calculation that can be used on any size cohort or sample. It depends only on what was 
observed during a study and not on any characteristics of a sample space. It does not require 
any advanced calculation. Practically all modern spreadsheets and statistical package programs 
(e.g., Microsoft Excel spreadsheet, R statistical package) have the capability to calculate what 
the analysis demands, providing only that packages can handle small-number factorials. 
Finally, the likelihood ratio, which is the measure of the strength of evidence, can be employed 
immediately in Bayes' theorem to see how prior beliefs about a hypothesis should be updated 
in the face of evidence. 

Although this article outlines a summer camp example, the key point rests with the 
power of using quantitative analysis with a small population sample. It is posited that utilizing 
quantitative methods with small sample sizes, which would normally not be analyzed 
statistically, will strengthen insights into data trends and reveal implications for modifications 
that could have gone unnoticed. Multiple audiences could benefit from garnering the potential 
of a small size quantitative investigation. 


Note 


This work has been approved by the University of Wyoming Institutional Review Board 
(IRB) on August 19, 2022. Code: #202208 19TK03373. 
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Abstract 


Inclusive education presents a significant challenge for contemporary society. All children should have 
the opportunity to develop according to their educational needs within an inclusive environment. The 
effectiveness of the school support team plays a crucial role in achieving this goal. This research aimed 
to explore the perspectives of teaching staff in kindergartens, including headmasters, teachers, and 
teaching assistants, regarding inclusive education, with a specific focus on their views and attitudes 
towards the roles of school special educators and teaching assistants in preschool education. A 
mixed-methods research strategy was employed to achieve this aim. Data were collected using a self- 
constructed questionnaire containing both closed and open items, completed by 394 respondents from 
142 kindergartens. The findings indicated that teaching staff perceived the existence of a school support 
team as having a positive impact on addressing various children's issues and enhancing teachers' work. 
These results contribute to a broader understanding of the roles and responsibilities of the members of a 
school support team in kindergartens. 

Keywords: inclusive education, kindergarten, preschool education, school special educator, school 
support team, teaching assistant 


Introduction 


An international trend in promoting inclusive education for all children in their natural 
environment is the reduction of the number of children educated in separate schools and 
classes for those with special educational needs. However, some European countries still have 
a high number of such segregated children, which contradicts the aforementioned international 
commitments and trends. For example, in Slovakia, the proportion of children with special 
educational needs is the fourth highest in Europe, comprising almost a fifth of the primary 
school population. Unlike many other European countries, a large proportion of these children 
in Slovakia do not attend mainstream primary schools alongside their peers. Slovakia ranks first 
among European countries in the proportion of children educated separately in special classes 
or schools for children with special educational needs (European Agency for the Development 
of Special and Inclusive Education, 2014; Hall et al., 2019; Klein, 2020). Addressing this 
unfavourable situation requires the implementation of inclusive education. The current societal 
challenge is to embrace the concept of inclusive education, rooted in the essence of inclusion: 
mutual acceptance and the promotion of a gradual shift toward unconditional acceptance of 
diversity through lifelong education. This approach is fundamental to an inclusive society, 
aiming for equality for all people without distinction. 
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Literature Review 


The educational system in Slovakia reflects the significant need to tailor education and 
learning to each child's individual needs and to support their development through lifelong 
learning within an inclusive education framework. This necessitates improving the quality of 
human resources in schools, introducing innovation, and enhancing the efficiency of not only 
teaching and professional staff but also all stakeholders involved in providing care, assistance 
and support to children. Establishing a school support team and ensuring its effective operation 
is crucial for creating an inclusive, supportive environment that enables all children to reach their 
maximum potential. A school support team is a group of professionals working in kindergarten, 
primary schools, and secondary schools to support children with special educational needs, as 
well as teachers and parents (School Support Team: A Theoretical and Practical Guide, 2022). 
These teams typically comprise a variety of professionals, including school special educators, 
school psychologists, social educators, speech and language therapists and other specialists 
essential for addressing children's special educational needs. For the first time, the concept 
of a school support team is officially included in the following laws: the Act of the National 
Assembly of the Slovak Republic No. 245/2008 Coll. on Education and Training (School Act) 
and the Act of the National Assembly of the Slovak Republic No. 138/2019 Coll. on Teaching 
and Professional Staff. According to these legislative norms, the headmaster of a kindergarten, 
primary school, or secondary school may establish a school support team for the purpose of 
inclusive education. The school's special education teacher and other professional staff are 
members of the school's support team. Other teaching staff may also be part of the school support 
team. The optimal composition of the school support team includes: school special educator and 
field special educator, psychologist and school psychologist, social educator, speech therapist 
and school speech therapist, therapeutic educator, career counsellor, prevention coordinator, 
class teacher, other teachers, tutors in the school children's club, and teaching assistant. 

The school support team performs the following tasks. Members of the team are involved 
in identifying special educational needs. Based on these identified needs, the school support 
team proposes individual or group support interventions. Furthermore, the team provides advice 
and methodological support to teachers in various situations within the educational process, 
aiding in the implementation of specific approaches and strategies for inclusive education. In 
doing so, it contributes to strengthening teachers' competencies to address challenges in line 
with the principles of inclusive education. Cooperation with teachers is essential in setting up 
necessary adjustments and appropriate teaching materials and aids. 

Members of the school support team collaborate with children's legal representatives, 
providing them with information and procedures to address dysfunctional communication. 
They also monitor the effectiveness of implemented measures and adjust them as needed. 
Additionally, they organise and participate in various forms of further training to enhance their 
educational and professional competencies. The team offers a comprehensive perspective on 
the individual problems and difficulties faced by children in at-risk situations and supports the 
creation of a positive school climate. 

Other tasks include the following: Coordinating educational and professional practices in 
close cooperation with support and prevention facilities. Participating in the development of the 
school's educational programme. Adapting the content of education to the individual needs of 
each child by modifying methods, forms, content, assessment, and classification. Contributing 
to the dissemination of inclusive education, thus eliminating prejudice and various forms of 
discrimination. Promoting open communication and cooperation among the different members 
of the school community in the educational process, including informal communication. 

The school special educator plays a key role in inclusive education as a member of 
the school support team. Their primary responsibility is to perform diagnostic activities. 
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They provide professional help and special educational counselling to children and their 
legal representatives within the framework of special educational intervention. Additionally, 
they offer methodological support to the teaching and professional staff of the school, supply 
information to counselling and prevention institutions, and participate in developing individual 
educational programmes, especially for children with special educational needs. They may also 
carry out direct educational activities. 

An essential part of the school support teams is the school psychologist who provides 
psychological diagnosis of children, crisis intervention, professional help, and psychological 
counselling within the framework of psychological intervention. The school psychologist 
offers various forms of psychological support to children, their families, and, where possible, 
school staff in the field of education and training. They participate in implementing preventive 
activities, improving and optimising relationships within classroom teams, and identifying 
children with special educational needs. 

In primary and secondary schools, the social pedagogue plays an important role, 
particularly by identifying potential difficulties in social relationships and providing early 
intervention. The social pedagogue performs activities to prevent the aggravation or recurrence 
of risky behaviour. They collaborate with teachers, legal representatives of the children, and 
other members of the school support team. 

The therapeutic educator, a member of the school support team, provides individual 
or group preventive and interventional therapeutic-educational support to children, their legal 
representatives, teaching and professional staff of the school. Their primary activities focus 
mainly on children with developmental risks. 

The school speech therapist conducts speech therapy orientation diagnostics and then 
provides speech therapy interventions and counselling for children with impaired communication 
skills. They also offer counselling to the children's legal representatives and coordinate with 
teaching and professional staff in the education of children with impaired communication skills. 

An integral part of the educational process is the pedagogical assistant, who plays a 
direct role in balancing the differences among children in the classroom. According to the 
requirements of the teacher and other educators, and in cooperation with members of school 
support teams, the teaching assistant creates equality of opportunity in education and training, 
helping children overcome various barriers. 

Several research studies address the issue of inclusive education. Many of them no longer 
question whether inclusion in education should be implemented, but rather focus on how it 
should be specifically implemented in school settings. In developed countries such as Finland, 
the USA, the UK, Denmark, Norway, Sweden and others, inclusive education is already being 
implemented, and research is focused on examining its outcomes and effectiveness. However, 
the situation in Slovakia is different. The education system in Slovakia is highly segregated, and 
school inclusion is only in its early stages. Kozarova (2022a, 2022b) cited examples of good 
practices from abroad where curriculum modification, which respects the inclusive paradigm 
in education, has brought numerous benefits to the educational outcomes of both children with 
special educational needs and other children. Curriculum inclusivity, along with personalisation 
tailored to children and their needs, was most successful where school support teams were an 
integral part of the school. Numerous scientific studies (e.g. Cabanova & Tinka, 2021; Carnicka 
et al., 2023; Ku8nirova et al., 2023; Silonova et al., 2021; Zhu et al., 201 9) advocate for inclusive 
education, starting from preschool. The ultimate implementers of this approach are teaching and 
professional staff, whose perspectives from the field provide valuable feedback on the current 
state of inclusive education and what improvements are needed to benefit all stakeholders. 

The success of implementing inclusive education is highly dependent on the attitudes 
and opinions of teaching and professional staff in kindergartens, primary schools, and 
secondary schools. The first authors to address the issue of measuring the level of inclusion in 
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school settings were Booth and Ainscow, who created the Index for Inclusion in 2002. In 2004, 
Booth, Ainscow, and Kingston published a scientific monograph that, among other things, 
focused on preschool education and early childcare. Preschool education is the specific focus 
of the ICP's The Inclusive Classroom Profile (2021), which measures the quality and level 
of inclusion in kindergarten classrooms. The six-year field research by the authors of Solid 
foundations: Leading change in a kindergarten focused on document analysis and interviews 
with kindergarten teachers, which allowed them to identify seven practical principles of 
inclusive education: taking personal responsibility for each child; demonstrating self-control 
and providing rational solutions; offering children opportunities for meaningful activities; 
building a learning curriculum; instilling children with the skills of independent choice; 
facilitating learning in stages; and guiding children to acquire skills related to learning (Shoval 
& Sharir, 2019). 

In Hong Kong, inclusive education has been promoted in schools since the 1990s and has 
now been extended to preschool education. However, without qualified teachers and sufficient 
resources, it is difficult to implement inclusive education in the kindergarten environment. The 
authors presented Jmplementing inclusive education in an early childhood setting: A case study 
of a Hong Kong kindergarten explored how inclusive education is implemented in a mainstream 
kindergarten in Hong Kong (Zhu et al., 2019). The study involved children with special 
educational needs, teachers, parents, and the school headmaster employing a triangulation of 
research methods: observation, interviews, and document analysis. The results showed that a 
variety of inclusive practices were implemented in the kindergarten, and despite challenges 
and difficulties, all case study participants expressed positive attitudes toward the inclusive 
programme (Zhu et al., 2019). Kubanova and Kontsekova (2015) addressed good examples of 
inclusive education practices in the UK, with an emphasis on the education of Roma children. 
They analysed the state of preschool education through the implementation of the Sure Start 
programme. The aim of this project was to find solutions for working with families in poor 
communities and to contribute to the development of preschool children through parental 
education. This publication also includes the creation of tools to assess the level of inclusion in 
kindergartens. 

Gladush (2018, 2020) has long focused on preparing future teachers and special educators 
to work in inclusive education settings. In the kindergarten environment, the process of 
introducing inclusive education in Ukrainian preschools began in 2013 with the implementation 
of the All-Ukrainian Step by Step Foundation's Ukraine-Canada project entitled "Inclusive 
Education for Children with Special Needs in Ukraine" (Hrabovets et al., 2022). 

BeleSova and Kuchtova (2018) published an empirical study that reviews topics and 
scientific findings from research on preschool education in the Slovak Republic between 2005 
and 2015. The main aim of the study was to analyse the themes addressed in the research on 
preschool children's education. The research also addressed the issue of inclusion, such as the 
inclusion of Roma children and children with disadvantages. For Roma children, it was found 
that they make progress in mixed groups, but they are largely influenced, often negatively, 
by their family environment. The inclusion of disadvantaged children in kindergartens was 
considered beneficial for both disadvantaged and typically developing children. However, the 
research also indicated a negative aspect: the low preparedness of educators in working in 
inclusive education and shortcomings in legislative documents on this issue. 

The results of the analysis of the /t Makes Sense initiative showed that only 20% of 
teaching and professional staff believed their school was ready to educate children with special 
educational needs (Hall et al., 2020). A large proportion of kindergarten staff felt that the best 
form of education for this group of children was segregation, education in a special class or 
special school. In 2021, the Methodological and Pedagogical Centre in Bratislava conducted 
an extensive survey focused on the contribution of helping professions in inclusive education 
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in schools. This survey, part of the national project Helping professions in the education of 
children and students, included 3,197 respondents. The results clearly demonstrated the 
necessity of school special educators (as part of school support teams) and teaching assistants in 
the education of children in kindergartens. The authors of the survey recommended improving 
the cooperation between teaching and professional staff with teaching assistants in diagnosing 
and stimulating children's development in preschool education, with an emphasis on children 
with health and social disadvantages (Juséakova et al., 2021). Silonova and Klein (2018, 2019, 
2020, 2021, 2022, 2023) have long focused on the issue of inclusive education at the preschool 
level in Slovakia. They are conducting longitudinal research as a part of the national scientific 
projects VEGA, KEGA and national inclusive projects from 2015 to 2024. The aim of their 
research is to contribute to improving the quality of inclusive education, inclusive diagnostics, 
and evaluation of the level of inclusiveness of schools through school support teams. These 
teams, aligned with the concept of inclusive education, operate in kindergarten environments. 


Research Issue 


The research focused on the evaluation of the work of school support teams in kindergarten 
settings in the Slovak Republic. It aimed to identify the quality of processes in the creation of 
school support (inclusive) teams in kindergartens, in which school special educators or other 
categories of professional staff play a key role. In making the work of school support teams more 
effective, it is necessary to gain a more detailed insight into the work of its individual members. 
In kindergartens, these are primarily school special educators and teaching assistants. Insight 
into their work can be acquired through the views of the teaching staff in kindergartens who 
work closely with the members of this team. For this reason, the views of kindergarten teaching 
staff (kindergarten headmasters, teachers and teaching assistants) on inclusive education were 
researched with an emphasis on the views and attitudes towards the professions of school 
special educator and teaching assistant and their work in preschool education. 


Research Questions and Hypotheses 


Based on the analysis of the theoretical background, field experience, and the formulated 

research problem, the research questions were stated: 

1. What is the opinion of the teaching staff on the existence of a school support team 
in kindergarten in terms of its positive impact on the development and solution of 
various problems of the children? 

2. What is the opinion of the teaching staff on the existence of a school support team in 
kindergarten in terms of positive impact on the work of teachers? 

3. What is the importance of the activities in the work of a school special educator from 
the perspective of the teaching staff? Which activity is considered to be the most 
important? 

4. What is the importance of the activities in the work of a teaching assistant from 
the perspective of the teaching staff? Which activity is considered to be the most 
important? 


Research Methodology 
General Description 


This research is part of a national project entitled Possibilities of Inclusive Education of 
Students with Special Educational Needs. It is part of a longitudinal series of national research 
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projects previously conducted in Slovakia. These projects primarily focus on implementing 
inclusive measures in educational practice. The research specifically examined the educational 
trajectories of the children who were part of these studies. The ambition of the research findings 
is to contribute to the improvement of inclusive education, inclusive diagnostics, and the 
evaluation of the inclusiveness of schools through school support teams. In addition to this, 
the activities of these school support teams were also examined as they operated in mainstream 
school settings in accordance with current school legislation. 

To research the views of kindergarten teaching staff on the work of the school support team, 
a mixed-methods research strategy was employed. Initially, a literature review was conducted. 
Based on this review, a questionnaire containing both closed and open items was constructed, 
and pilot tested. Data collection took place between May 2023 and August 2023 using the self- 
constructed questionnaire. The responses were evaluated, analysed and interpreted. 


Sample 


The population consisted of kindergarten headmasters, teachers, and teaching assistants 
working in kindergartens within Slovakia. According to the Centre for Scientific and Technical 
Information, there were a total of 17,811 kindergarten teachers and 292 teaching assistants 
in Slovakia in 2023. In calculating the sample, the measurement error was set at 5%, the 
confidence level at 95%, the size of the population at 18,103 and the response distribution at 
50%. The calculated sample (minimum recommended size) is 377 respondents. The statistical 
sample consisted of 394 respondents from 142 kindergartens in the Slovak Republic, including 
kindergarten headmasters, teachers, and teaching assistants. The composition of the sample by 
gender and level of education corresponds to the typical proportions in the educational sector 
in Slovakia. 

The highest proportion of respondents falls within the age range of 20 to 50 years 
(73.85%). A significant 53.55% of respondents reported having between 0 to 10 years of 
teaching experience. Regarding educational attainment 208 respondents (52.8%) among the 
teaching staff hold first, second, and third degrees. Table 1 presents the characteristics of the 
respondents, including gender, age, length of teaching experience, education, and their working 
positions. 
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Table 1 
Characteristics of the Sample 


Gender N % 
Female 384 97.46 
Male 10 2.54 
Age N % 
18 - 20 years 5 1.27 
21 - 30 years 80 20.30 
31 - 40 years 108 2741 
41 - 50 years 103 26.14 
51 - 60 years 719 20.05 
61 - 70 years 19 4.82 
Length of experience in the education sector N % 
0 - 10 years 211 53.55 
11 - 20 years 66 16.75 
21 - 30 years 42 10.66 
31 - 40 years 56 14.21 
41 - 50 years 19 4.82 
Highest level of education attained N % 
Completed secondary education 179 45.43 
Bachelor's degree (Level 1 university degree) 123 31.22 
Master's degree (Level 2 university degree) 81 20.56 
Doctoral degree (Level 3 university degree) 4 1.02 
Other (€.g., post-secondary education, primary education, ...) 7 1.78 
Working position N % 
Headmaster 65 16.50 
Deputy headmaster 28 7.11 
Teaching assistant 119 30.20 
Teacher 176 44.67 
Kindergarten management 1 0.25 
Social pedagogue 1 0.25 
Parental assistant 2 0.51 
Other professional staff 2 0.51 


Instruments and Procedures 


A self-constructed questionnaire titled ‘Evaluation of the Work of the Kindergarten 
Inclusion/Support Team’ was employed to research the perceptions of respondents regarding 
the kindergarten inclusion/support team. The questionnaire primarily aimed to describe 
phenomena and events, which posed challenges in analysing its reliability. Therefore, pilot 
testing was conducted to assess the quality of the items and propose necessary modifications. 
In this process, minimal adjustments were made and integrated into the final version of the 
questionnaire (see Appendix). The validity of the research instrument was confirmed through 
expert evaluation. 

The questionnaire was administrated to kindergarten headmasters, teachers, and teaching 
assistants from May 2023 to August 2023. It consisted of five items, four of them employing 
multiple scales for assessment. Initially, respondents were asked to evaluate whether the 
presence of a school support team in the kindergarten positively impacted the development and 
resolution of various challenges encountered by children and teachers, respectively. 
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The respondents provided their answers using a scale ranging from Strongly agree - 
Somewhat agree - Cannot accurately judge - Somewhat disagree - Disagree. For items 3 and 
4, respondents identified the most critical activities performed by the school special educator 
and the teaching assistant within the school support team. Additionally, the respondents had 
the opportunity to add activities not listed and rate their relative importance on a five-point 
scale: Very necessary - Necessary - Moderately necessary - Not very necessary - Completely 
unnecessary. In the fifth item, respondents were invited to share their opinions on the roles of 
school special educators and teaching assistants within the school support team. 

The research with human participants was conducted in accordance with the general 
ethical standards. The respondents were informed that the questionnaire was anonymous, and 
the results of the survey were used only to evaluate the effectiveness of the work of inclusive/ 
supportive teams in kindergartens. 


Data Analysis 


Descriptive statistics, encompassing absolute frequencies, relative frequencies, mean, 
standard deviation, median, and mode were used for data analysis. To ascertain statistically 
significant differences in the responses of the respondents, a Chi-square test was conducted. The 
data were analysed to address the research questions effectively. 

In addition, a qualitative approach to data analysis was utilised to examine respondents' 
elaborations on the topic in the open-ended questionnaire item. The qualitative data underwent 
open coding and skeleton analytic narrative to extract meaningful insights. 


Research Results 


In the first item of the questionnaire, respondents provided feedback regarding the 
presence of a school support team in their respective schools and identified its members. They 
also shared their opinions on the positive impact of having a school support team (see Table 2). 


Table 2 
The Positive Impact of Having a School Support Team 


For the development and solution of 


Statement various: children's iesuee On the work of our teachers 
Strongly agree (%) 68.3 59.9 
Somewhat agree (%) 28.9 33.2 
Cannot accurately judge (%) 2.5 43 
Strongly disagree (%) 0.3 2 
Disagree (%) 0 0.5 
Average 4.65 4.50 
Median 5 5 
Mode/mode frequency 5 / 269 5/236 
Standard deviation 0.54 0.72 
Coefficient of variation (%) 11.65 16.03 


A total of 97.20% of the respondents strongly or somewhat agreed that the presence of a 
school support team positively impacts on the development and resolution of various children's 
issues. Regarding the impact on teachers' work, 93.1% of respondents agreed, with 75.6% 
strongly agreeing and 17.5% somewhat agreeing. The Chi-square test was employed to assess 
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the statistical significance between affirmative and other responses. For the first statement, Chi- 
square value ¥?(1) = 226, p < .001. For the second statement, Chi-square value y?(1) = 180.3, p 
< .001. In both cases, a statistically significant difference was found between respondents who 
agreed with the statement and those who did not. 

The survey also captures perspectives from all respondents’ categories regarding the 
roles of school special educators or other professional staff members in their respective areas 
of expertise, as outlined in Table 3. Statistical analysis using the chi-square test determined 
significant differences across all statements. Significant variations were observed, ranging from 
the lowest Chi-square value y?(1) = 72, p < .001 for the tenth statement in rank order, to the 
highest Chi-square value y?(1) = 185.5, p < .001 for the second statement in rank order. 


Table 3 
The Work of a School Special Educator or Other Professional Staff Member 


3 a = 
> xs B s 
: a 2 sc 8 
The most important activities in the work > 3 o 2 2 c 
. a 4 Qn € & > 
of a school special educator or other S x0 2 9% 5 3 5 
professional staff member from the 2 > 2 22 = r= 
F ° o 2 2 a) o 
perspective of the respondents 2 2 6 > 2 & S S x) 
pS 8st s BES SB 
S$ 2 5s Z2ox ££ 5S =F DB (5) 

1. Diagnosing and identifying the specific 
causes of children's problems according to 675 256 63 03 03 460 5 5 0.64 13.99 


diagnostic and stimulation programmes for 3- to 
6-year-olds. 


2. Stimulating children's development according 

to diagnostic and stimulation programmes for 645 292 51 10 03 457 5 5 0.66 14.52 
3- to 6-year-olds. 

3. Providing direct support for children in 

developing social relationships and resolving 614 310 48 20 08 450 5 5 0.75 16.64 
conflicts. 

4. Offering direct assistance to children in the 
areas such as self-awareness, self-control, and 
overcoming the subjective consequences of 
their problems. 


58.1 348 53 13 05 449 5 5 0.70 15.68 


5. Guiding educators on strategies to improve 


: : : 442 386 114 41 18 419 4 5 0.92 21.90 
the social environment in the classroom. 


6. Providing expert advice to teachers on 


; ; . : 48.0 368 10.7 30 15 427 4 5 0.88 20.65 
diagnosing and evaluating children. 


7. Organising professional events for educators, 


: a : 39.6 426 122 33 23 414 4 4 0.92 22.11 
including discussions and workshops. 


8. Offering advice and consultation to parents 


; 58.1 322 71 18 08 445 5 5 0.77 17.24 
of children. 


9. Organising professional events for parents, 


: ; 38.6 414 135 48 18 410 4 4 0.93 22.68 
such as discussions and lectures. 


10. Conducting home visits. 459 33.0 160 28 23 418 4 5 0.95 22.83 


11. Maintaining contact and communication with 
professional institutions to provide assistance to 49.2 398 81 08 20 434 4 5 0.82 18.97 
children and parents. 


12. Handling specific administrative tasks and 


; 426 409 117 23 25 419 4 5 0.91 21.75 
documentation. 
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Following the previous questionnaire item, a series of questions explored the respondents' 
subjective perceptions of the quality and necessity of the work conducted by teaching assistants. 
The findings are detailed in Table 4. 

Statistical analysis using the Chi-square test was employed to evaluate the significance 
of the differences observed. Statistically significant differences were identified across all 
statements, with the lowest Chi-square = y?(1) = 9.95, p < .001for the eleventh statement in 
the sequence, and the highest Chi-square y?(1) = 261.8, p < .001for the first statement in the 
sequence. 


Table 4 
Work of Teaching Assistant 


~ > = 
> se 8 8 
o Pp og < ® 
: er ‘ 3s 8 oS © 2 = 
The most important activities of a teaching 2 9 o £ Ss 2 
assistant as a member of the school support B 3s 5 68 = 3 2 
team perceived by the respondents gs fF 3 > 2 " z So 
fc #@ § $a 8 & » S&S # 
5 8 8 35.$ 8 8 & 8 
> z = 2 os {= = = 7) (S) 
1. Providing individual assistance to children ; 
during educational activities in kindergarten. TA Te, TS MS: AIS eh tee 
2. Offering one-on-one support to children during 64.0 297 41 23 00 455 5 5 0.68 15.00 
play activities and outings in the kindergarten. ‘ ; ; ; 
3. Teaching social and hygiene habits. 741° 201 33 23 #03 465 5 5 0.68 14.58 


4. Facilitating communication in the children's 


‘ : a 645 254 69 25 08 450 5 5 0.80 17.66 
mother tongue (interpreting, explaining). 


5. Visits families facing challenges. 596 299 76 25 03 446 5 5 0.77 = 17.14 


6. Engaging children's parents in collaboration 


: 548 360 69 13 10 442 5 5 0.76 17.23 
with the school. 


7. Facilitating communication in minority 
languages (interpretation between parentsand 58.9 277 86 41 08 440 5 5 0.87 19.68 
school). 


8. Liaising with social service providers, 
community members, and local agencies. 


62.5 363 84 23 05 438 5 5 078 17.72 


9. Engaging with the broader community. 42.9 393 142 25 10 421 4 5 0.85 20.23 


10. Assisting teachers in preparing for classes. 44.2 315 135 86 23 407 4 5 1.06 26.09 


11. Aiding teachers with documentation tasks. 30,2 31,0 183 12,2 84 362 4 4 1.26 34.78 


4 


2. Supporting teachers in organising classroom 


nae 43,9 32,7 150 61 23 410 4 #5 1.02 24.77 
activities. 


4 


3. Assisting the school special educator/ 
professional staff in communicating with children 57.1 29.7 91 28 13 439 5 5 0.86 19.63 
in their mother tongue (interpreting, explaining). 
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Based on the research results, all categories of respondents overwhelmingly perceive the 
benefits of teaching assistants. The activities deemed very necessary include individual help 
to children during educational activities in kindergarten (96.4%), individual help to children 
during play activities and outings in kindergarten (93.7%), teaching social and hygiene habits 
(94.2%), ensuring communication in children's mother tongue (89.9%), visiting families facing 
challenges (89.5%), and involving children's parents in cooperation with the school (90.8%). 

In addition to the aforementioned duties, kindergarten staff consider the following areas 
of a teaching assistant's work to be important and necessary. The majority of teaching assistants 
assist the school's special educator or professional staff in communicating with children in their 
mother tongue, e.g., interpreting, explaining (86.8%), ensuring communication in the minority 
language, e.g., interpreting between parents and the school (86.6%), communicating with social, 
community, and outreach workers in the region (88.8%), assisting the teacher in preparing for 
lessons (85.7%), maintaining documentation (61.2%), and organising classroom work (76.6%). 

At the end of the questionnaire, respondents were given the option to provide anonymous 
feedback on issues related to the role of school special educators and teaching assistants. 
Respondents expressed their opinions on the need to employ teaching assistants, and special 
educators in kindergartens. They considered these professions to be important, helpful, and 
beneficial, believing they were essential components of an inclusive school. Respondents 
emphasised the necessity of these roles when working with children with special educational 
needs, children from other national minorities, or socially disadvantaged children. They 
highlighted the value of these professionals in facilitating communication between assistants 
of a given national minority and the parents of children, as well as in overcoming linguistic 
barriers. The feedback indicated that teaching assistants and special educators are crucial in 
kindergartens due to their ability to provide individual attention to children. Additionally, it was 
noted that teaching assistants should possess at least an additional qualification in education to 
foster a kind and empathetic attitude towards children and to demonstrate acceptance within 
the kindergarten setting. 


Discussion 


The promotion of inclusive education has been successfully addressed in many countries 
in Europe and around the world, as evidenced by numerous research studies cited in the 
Literature review section (Gladush, 2018, 2020; Kozarova, 2022b; Kubanova & Kontsekova, 
2015; Shoval & Sharir, 2019; Zhu et al., 2019). However, in Slovakia, this issue is relatively 
new, particularly concerning the establishment and functioning of school support teams for the 
purpose of inclusive education. For this reason, it was necessary to establish new knowledge 
and facts about the functioning of these teams. The research specifically focused on the work of 
school-based special educators and teaching assistants. 

The research explored the views of the teaching staff on the existence of a school 
support team in kindergarten, particularly regarding its positive impact on the development and 
resolution of various problems of children. The findings indicate strong agreement among the 
teaching staff, with 97.2% of the respondents expressing their approval. The difference between 
the respondents who agreed and those who did not was found to be statistically significant. 

The research also focused on the opinions of the teaching staff regarding the existence 
of a school support team in the kindergarten, particularly its positive impact on teachers’ work. 
The results showed that the respondents were in agreement on this point as well, with 93.1% 
expressing approval. The difference between the respondents who agreed and those who did not 
was Statistically significant. 

The research focused on the most important activity in the work of a school special 
educator from the perspective of teaching staff. The results of the Chi-square test indicated 
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that the most crucial aspect of a school special educator's work is the stimulation of children's 
development according to diagnostic and stimulation programmes for children aged 3 to 6 
years. Additionally, the research also explored the most important activity in the work of a 
teaching assistant from the perspective of teaching staff. The majority of the respondents 
(96.4%) agreed that individual help to children during the educational process in kindergarten 
is the most important activity for teaching assistants. 

The research results are in accordance with the research by Karademir et al. (2017). 
Based on interviews with teachers regarding the impact of teaching assistants on educational 
quality, it was concluded that teaching assistants can indeed enhance the overall quality of 
education. Similarly, it has been confirmed by teaching staff that teaching assistants play a 
crucial role in kindergartens. Gezer and Aksoy (2019), in their research, also view the presence 
of teaching assistants positively in preschool classrooms. According to their findings, preschool 
teachers noted the absence of teaching assistants as a significant issue. 

The opinions of teaching staff are shaped not only by their own teaching experiences 
but also by their educational background. Attitudes towards inclusive education often become 
entrenched early in teachers' training. For instance, Cabanova and Trnka (2021) found that 
students in faculties of education are often hesitant about envisioning themselves as future 
teachers of children with special educational needs, and these attitudes tend to persist despite 
their exposure to inclusive education concepts. Similarly, Rochovska et al. (2023) observed that 
teachers' attitudes towards inclusion were unaffected by their participation in inclusion-focused 
projects. 

Conversely, Carvalho et al. (2024) examined Portuguese teachers’ attitudes towards 
inclusive education and discovered generally positive sentiments, although this study did not 
exclusively focus on kindergarten teachers. 


Conclusions and Implications 


The research results highlight the view of teaching staff regarding the roles of school 
special educator and teaching assistant in fostering conditions for the implementation of inclusive 
education in Slovakian kindergartens. These teaching staff recognise the positive impact of 
having a school support team on children's development and problem-solving capabilities, as 
well as on the teachers' work. 

Across all respondent categories (kindergarten headmasters, teachers, and teaching 
assistants), there is a strong consensus regarding the significant contribution of school special 
educators in stimulating children's development according to diagnostic and stimulation 
programmes tailored for children 3 to 6 years old. 

All respondent categories overwhelmingly acknowledge the crucial role of teaching 
assistants (considered very necessary) in various areas: providing individual assistance to 
children during educational and play activities and outings in kindergarten, teaching social 
and hygiene habits, facilitating communication in children's mother tongue (interpreting, 
explaining), conducting visits to families facing challenges, engaging parents in collaboration 
with the school, and assisting teachers in organising classroom activities. 

The findings contribute to the general assessment of inclusive education in kindergartens 
in Slovakia. From the perspective of kindergarten teaching staff, the research confirmed that 
the effective work of school support team members, especially school special educators and 
teaching assistants, is a necessary and enormously important determinant of inclusive education 
for preschool children. 

The findings significantly contribute to the overall evaluation of inclusive education 
in Slovakian kindergartens. According to kindergarten teaching staff, the research confirms 
that the effective collaboration of school support team members, particularly school special 
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educators and teaching assistants, is a critical and highly valuable factor in promoting inclusive 
education for preschool children. The above findings could be further enriched by incorporating 
the perspectives of school special educators and teaching assistants themselves. It is crucial to 
ascertain how their views align with those of the teaching staff regarding the effectiveness of the 
support team's work. Moreover, it would be beneficial to gather insights from all stakeholders, 
including children and their parents. The implications for future quantitative research could be 
enhanced by conducting case studies that delve into the operations of school support teams in 
particular kindergartens. 
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Appendix 
Questionnaire: Evaluation of the work of the kindergarten inclusion/support team 


Dear Headmaster, Dear Teacher! 

Your school has signed up for the idea of inclusive education by joining the NP PRIM II. Inclusion is not 
a permanent ideal state but is a never-ending process of school improvement in all areas. The present 
questionnaire monitors whether the conditions for inclusive education are gradually being fulfilled in 
your kindergarten through inclusive teams, which include the school's special educator or a professional 
staff member and a teaching assistant. The questionnaire is anonymous, and the results of the survey will 
be used to evaluate the effectiveness of the work of inclusive/supportive teams in kindergartens. 


Kindergarten: 
Gender: 
a) Male b) Female 
Age: 
a) 18-24 years c) 35 - 44 years 
b) 25 - 34 years d) 45 - 54 years 


e) over 55 years 
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536| Length of experience in the education sector: 
a) Without experience c) 4-9 years 
b) 1-3 years d) 10 a years 
e) Over 20 years 


Highest level of education attained: 
Study programme: 


1. The presence of a school support team in the kindergarten has a positive impact on the 
development and resolution of various problems encountered by children. (Choose one option.) 
- Strongly agree 
Somewhat agree 
Cannot accurately judge 
Somewhat disagree 
Disagree 


2. The presence of a school support team in the kindergarten has a positive impact on the teacher’s 
work. (Choose one option.) 
- Strongly agree 
Somewhat agree 
Cannot accurately judge 
Somewhat disagree 
Disagree 


3. What do you consider to be the most important aspect of the work of the school special 
educator as a member of the school support team? (Choose one option in each statement.) 


a) Diagnosing and identifying the specific causes of children's problems according to diagnostic and 
stimulation programmes for 3- to 6-year-olds. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


b) Stimulating children's development according to diagnostic and stimulation programmes for 3- to 
6-year-olds. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


c) Providing direct support for children in developing social relationships and resolving conflict. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


d) Offering direct assistance to children in the areas such as self-awareness, self-control, and 
overcoming the subjective consequences of their problem. 


Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


e) Guiding educators on strategies to improve the social environment in the classroom. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


f) Providing expert advice to teachers on diagnosing and evaluating children. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


g) Organising professional events for educators, including discussions and workshops. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


h) Offering advice and consultation to parents of children. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


i) Organising professional events for parents, such as discussions and lectures. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 
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j) Conducting home visits. 537 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


k) Maintaining contact and communication with professional institutions to provide assistance to 
children and parents. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


1) Handling specific administrative tasks and documentation. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


4. What do you consider to be the most important aspect of the work of the teaching assistant as a 
member of the school support team? (Choose one option in each statement.) 


a) Providing individual assistance to children during educational activities in kindergarten. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


b) Offering one-on-one support to children during play activities and outings in the kindergarten. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


c) Teaching social and hygiene habits. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


d) Facilitating communication in the children's mother tongue (interpreting, explaining). 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


e) Visits families facing challenges. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


f) Engaging children's parents in collaboration with the school. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


g) Facilitating communication in minority language (interpretation between parents and school). 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


h) Liaising with social service providers, community members and local agencies. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


i) Engaging with the broader community. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


j) Assisting teachers in preparing for classes. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


k) Aiding teachers with documentation tasks. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


1) Supporting teachers in organising classroom activities. 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 


m) Assisting the school special educator/professional staff in communicating with children in their 


mother tongue (interpreting, explaining). 
Very necessary — Necessary - Moderately necessary - Not very necessary - Completely unnecessary 
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5. If you need to express your opinion on the work of school special educators or teaching 
assistants, this is the place to do it. 


Thank you. 
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Abstract 


In a classroom environment where refugee students are present, teachers’ attitudes towards these students 
are considered to be one of the important key factors affecting the students' adaptation process to the 
education system and the society in which they live. Based on this important factor, the aim of the study 
was to improve teacher attitudes with the "Attitude Improvement Module towards Refugee Students" 
designed by the researchers and to contribute to professional development studies on the subject by taking 
teachers' views about the module. In the research process, an attitude scale was used to measure teachers' 
attitudes towards these students, covering the dimensions of communication, harmony and proficiency, it 
was applied to the teachers in the experimental and control groups before and after the module and the 
attitudes of the teachers before and after the module were analyzed. After the analyses, teachers' views 
were sought regarding the results. As a result of the quantitative analyses conducted in this mixed-method 
research, a decrease was observed in the arithmetic average of the communication and adaptation 
dimensions, while an increase was observed in the arithmetic average of proficiency in the dimension. 
According to the qualitative analysis, it was revealed that teachers had feelings such as "prejudices, 
inability to accept refugees, language problems" towards refugee students, but after the module was 
implemented, their feelings, such as "gaining awareness and empathic approach in refugee education", 
improved. Based on the findings, it is recommended to develop policies aimed at nurturing the emotional 
aspects of teachers as well as their proficiency in improving their attitudes towards refugee students. 
Keywords: refugee student education, improvement of teacher attitudes, mixed methods, exploratory 
sequential designs 


Introduction 


Due to its geopolitical location, Anatolian lands have served as a corridor throughout 
centuries due to migration waves from various countries. The intensity of migration waves 
reached its peak due to the ongoing Syrian civil war and Arab Spring events that have continued 
since 2011 (Keskin & Okgu, 2021; Ugurlu, 2018; Yasar et al., 2020), and Turkey hosted nearly 
4 million refugees (Yesildag, 2022). Refugees are defined as people who are forced to settle in 
a country other than their own due to the fear that they will be persecuted in where they were 
from the country in which they live and which they inherited from their ancestors because 
of their affiliation or opinion (IOM, 2009). Although there have been ongoing debates about 
the clarity of the concept (Dost, 2014), in this research, the term "refugee" has served as an 
umbrella term in describing individuals who had to migrateto another country and seek asylum 
due to the internal conflicts and wars in Syria (Sahin, 2020; Yasar et al., 2020). 

In addition to the physical mobility it creates, migration also leads to a social and 
economic structuring and differentiation process in the destination (Atmaca, 2020). For 
example, with the influx of refugees fleeing the internal conflict in Syria into Turkey, it is seen 
that social integration problems have emerged especially in provinces close to the country's 
border neighbors such as Gaziantep and Kilis (Yasar et al., 2020). As time goes by, the host 
region gets tired of showing hospitality and perceives refugees as a threat (Atas, 2021; Giinay 
et al., 2019). 
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When the current situation of migrant students in Turkey and studies on their adaptation 
processes to the education system are examined (Yasar et al., 2020), it is understood that more 
than 800,000 Syrian refugee students were enrolled in compulsory education (Ozdemir & 
Aypay, 2022), in other words, primary school, as of the beginning of 2021. The unprepared 
and sudden inclusion of students who came with migration into the system caused Turkish 
students’ reluctance to form groups and make friends with students (Keskin & Okcu, 2021) 
and also language and adaptation problems. In addition, the reluctance of school administrators 
to accept refugee students (Saglam & Kanbur, 2017), the rejections of refugee students by 
teachers, students and parents (Yasar et al., 2020) and the bullying towards refugee students 
also emerge as problems experienced by refugee students (Coskun & Emin, 2016). However, 
it can be said that an inclusive and qualified education (Karabacak, 2020) that refugee students 
receive in primary school will not only protect refugee students from exclusion, involvement 
in criminal activities, child labor, and child marriage (UNHCR, 2019), but also protect society 
from all these risk factors. 


Teacher Attitudes Towards Refugee Students 


Teachers have a major role in helping refugee students overcome the difficulties 
they face and integrate into society as qualified individuals (Kovinthan, 2016). It is vital 
that teachers have a positive attitude that refugee students can overcome the problems (Mogli 
et al., 2020) they face in their efforts to adapt to their schools and therefore to society, and that 
they can contribute to the new society (Kaukko et al., 2021). It is known that supportive teacher 
attitudes and activities provided to students facing various difficulties due to language and 
cultural differences accelerate the adaptation process (Fisher et al., 2000; Tosun et al., 2018). 
Therefore, improving teachers’ pre-existing knowledge and attitudes towards refugee students 
can be seen as the first step in fostering desired behavioral development and integrating students 
into society (Bacakova & Closs, 2013). 

However, attitudes signal problematic behaviors resulting from incorrect or incomplete 
knowledge about a particular subject (Robbins & Judge, 2017). According to Oskamp (1975; 
cited in Ugurlu, 2018), the most important factors in the formation of attitudes are personal 
experience, parental influence, school, and the individuals in one's surroundings. In this context, 
it is possible to say that teachers’ feelings, thoughts and attitudes towards refugee students are 
shaped within the framework of their awareness, knowledge and experiences about the students 
(Eagly & Chaiken, 2007). 

When examining the research focusing on teachers' awareness and education regarding 
refugee students, it is observed that in countries such as Germany, Austria, and the UK, 
teachers receive training on how to deal with problems such as communication, discrimination, 
exclusion, and prejudice, as well as on how to conduct classes considering multiculturalism 
(Toprakg1 & Yazici, 2021). In Turkey, it is stated that teachers do not receive pedagogically 
sufficient training on how to educate refugee students during their undergraduate studies 
(Osten et al., 2017; Toprake1 & Yazici, 2021). After starting their teaching careers, efforts have 
been made under the Ministry’s projects such as PICTES and Inclusive Education (Kara, 2022; 
OECD, 2020; UNICEF, 2018). However, it is observed that these trainings do not reach all 
teachers who have refugee students, and even if they do, teachers often lack sufficient awareness 
about the training (Aykini, 2017; Er & Bayindir, 2015). In the studies conducted, it is seen that 
the majority of teachers who do not have sufficient education and awareness believe that they 
cannot carry out the education of refugee children smoothly (Aykin, 2017) and are reluctant 
to provide education to refugee students. Therefore, it is understood that there is a need for 
awareness (Kése et al., 2018) and multicultural education (Yurdakul & Tok, 2018), as well 
as professional development (Erdem, 2017), specifically targeting teachers' needs, but such 
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planning is not being made by the Ministry. For this reason, it can be said that in order to 
improve the attitudes of teachers working in Turkey towards refugee students, practices that 
will provide teachers with awareness and professionalism about refugee students and refugee 
student education should be developed (Karabacak, 2020). 

When the studies conducted in the academic field are examined, it is understood that 
teachers' attitudes towards refugee students are taken with quantitative studies and the attitudes 
are examined in the context of different variables (Ciftci, 2019; Kazu & Deniz, 2019; Keskin 
& Okcu, 2022; Kése et al., 2019; Kilcan et al., 2017). In addition to this, there are quantitative 
studies linking teachers' attitudes towards refugee students with multicultural education, school 
climate, and organizational commitment (Akman, 2020; Dolapci & Kavgaci, 2020; Kirimh, 
2022). In qualitative research, teachers' views about refugee students (Aykin, 2017; Basaran, 
2021; Kardes & Akman, 2018; Yurdakul & Tok, 2018) and the problems they encounter (Erdem, 
2017; Basar et al., 2018; Giilcegiil, 2020; Ozorug & Sigirtmac¢, 2022). Therefore, it can be said 
that studies that could increase teachers' knowledge and awareness regarding refugee students 
and enable them to develop positive attitudes have been overlooked. 


Research Focus 


In light of all this data, it emerges that the attitudes that teachers develop towards refugee 
students are a leading variable in ensuring that refugee students become qualified individuals 
in society, and that planning and implementation of activities aimed at improving teachers' 
attitudes are necessary. 


Research Aim and Research Questions 


In this research, it is argued that teachers' attitudes towards refugee students are the 
leading variable in supporting the adaptation of refugee students, who are rapidly integrated 
into the education system to the primary school level, to the system, where they have problems 
adapting to the system (Kaukko et al., 2021; Mogli et al., 2020). However, it is seen as a problem 
that teachers are unprepared for the rapid integration they encounter and that they do not have 
sufficient awareness and training to develop positive attitudes towards these students. For this 
reason, the research conducted, "Attitude Improvement Module towards Refugee Students", 
was developed in order to increase teachers' awareness of refugee students and refugee student 
education, and it was aimed to reveal how the module affects teachers' attitudes towards refugee 
students. In this context, answers to the questions determined as follows were sought: 

1) What is the impact of the Attitude Development Module towards Refugee Students on 
teachers' attitudes towards refugee students (communication, adaptation, proficiency)? 

2) What are the views of the teachers who participated in the Attitude Improvement 
Module towards Refugee Students about the module (its planning, scope, contribution, to 
whom it can be applied and the reasons for the quantitative results)? 


Research Methodology 
Research Design 
In this study, in order to reveal the impact of the "Attitude Improvement Module towards 
Refugee Students", the activities in the module were applied to teachers in the experimental 
and control groups, the attitudes of the teachers in the groups were determined by pre-test 


and post-test analyses, and then the impact of the module was examined comprehensively. In 
this process, the views of the experimental group teachers who participated in the activities 
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in the module were sought. A mixed design approach was adopted in the research because 
qualitative methods were used in the section of the research process regarding the module after 
the quantitative module in the section of the research process regarding the teachers' views 
(Tashakori & Creswell, 2007). 

In mixed methods research, there are different ways in which the quantitative and 
qualitative stages are related to each other (Tashakori & Creswell, 2007). Exploratory sequential 
designs allow the quantitative data obtained from the research to be examined with qualitative 
research methods and described by loading deeper meanings (Creswell & Plano-Clark, 2020). 
For this reason, the data regarding the test scores applied in the first part of the research were 
collected using quantitative methods and the stages of the explanatory sequential design were 
followed by applying the qualitative research method through interviews to explain the obtained 
data. 

In the quantitative phase of the conducted study, a pretest-post-test matched control 
group quasi-experimental design (Tabachnick & Fidell, 2007) was used to test the effectiveness 
of the designed module and the implementation of the module lasted for 6 weeks. The design 
of the quasi-experimental design is given in Table 1. 


Table 1 
Attitude Improvement Module Towards Refugee Students Quasi-Experimental Research 
Design 


Groups Pre-test Process Post-test 
ExperimentalGroup Attitude ImprovementModule Towards 

(15 Teachers) Rene Refugee Students (6 weeks) Rene 
Control Group(15Teachers) RSAS - RSAS 


Refugee Student Attitude Scale=RSAS 


After completing the quantitative method section, the aim of explaining the participants' 
perspectives on the applied module required adhering to the nature of qualitative research 
methods. A case study, which is within the scope of qualitative research, is based on examining 
a situation that people experience in real life within a limited time period (Mariam, 2018; Yin, 
2009). Therefore, the fact that the research design covers a limited time period of 6 weeks, and 
the module is based on real-life experiences required the adoption of a case study. 


Participants 


The research was conducted with teachers working in two primary level public schools 
in Kilis province in the 2022-2023 academic year. The selection of schools was based on 
the purposeful sampling and criterion sampling methods, which are sampling methods with 
unknown probability (Marriam, 2018). The criterion used in determining the schools was 
that at least 50% of the students enrolled in the schools were refugee students. In addition, 
attention was paid to ensuring that the demographic structure of the teachers in the schools to 
be selected was similar. In this context, two primary schools, each with 20 classroom teachers, 
were selected and experimental and control groups were created. The teachers assigned to the 
experimental (7=15) and control (7=15) groups were formed on a voluntary basis. The purpose 
of selecting the groups from different schools was to minimize the possibility of sharing the 
activities carried out during the implementation of the module between the groups. 
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According to the demographic information of the participants, the majority of the 
participants in both groups are 30 years old and over, and the density of male and female 
participants is similar. When looking at marital status, it was determined that 80% of the 
participants in the experimental group and the control group were married, and 20% were 
single. When the professional seniority of the participants is examined, it is seen that the 
majority of the participants in the groups have 11—15 years of professional seniority (26.7%). 
It is also understood that all of the participants were undergraduate graduates. Based on all this 
data, it can be argued that the experimental and control groups determined for the research are 
homogeneous among themselves. 

Participants in the qualitative dimension of the research were selected on a voluntary 
basis from the participants in the experimental group consisting of 15 people. Accordingly, 
qualitative data were obtained through face-to-face interviews with 13 volunteer teachers. 


Data Collection 


Research data were collected after obtaining ethics committee permission for the research. 
In the first step of the research, the quantitative method section, RSAS (Saglam&Kanbur, 
2017) was applied to the groups as a pretest. Then, the activities in the module designed by 
the researchers were carried out with the participants in the experimental group in the schools 
where they worked. Activities were held once a week for 6 weeks. No activity was organized 
for the control group for 6 weeks. In this context, the module designed by the researchers and 
carried out with the teachers in the experimental group was taken as the independent variable, 
and the attitudes of the teachers who participated in the activities were taken as the dependent 
variable. After the completion of the module, RSAS was re-applied to the groups as a post-test 
to demonstrate the impacts of the module. Therefore, the scores obtained as a result of pre-test 
analysis and post-test analysis were presented as the quantitative data of the research. 

During the qualitative data collection process, data was obtained through face-to-face 
interviews held at an appropriate place and time with participants selected from the experimental 
group on a voluntary basis. The interviews lasted approximately 20 minutes. In order to prevent 
data loss during the interviews, the participants' opinions were recorded on a voice recorder 
with their approval. To protect the identities of the participants, their names were coded as P1, 
P2 (P1=Participant | etc.). Additionally, participants' attitudes and behaviors were observed 
and documented every week during the 6-week study period. 


Content of the Attitude Improvement Module Towards Refugee Students 


During the module creation phase, the recommendations of professionals such as 
psychological counselors, clinical psychologists and academics who have done studies on 
refugee students were taken into consideration. Before creating the module, preliminary 
interviews were conducted with teachers to conduct a needs analysis. Additionally, studies 
focusing on teachers' attitudes towards refugee students (Biasutti et al., 2019; Bozkurt, 2018; 
Erdem, 2017; Habib, 2020; Levi, 2019; Sevi et al., 2017; Sevin¢g, 2021) were reviewed. 
The activities included in the module were designed taking into account the Message 
Learning (YALE) approach developed by renowned psychologists (Sakalli Ugurlu, 2018). In 
addition, the activities are prepared according to the three sub-dimensions in the scale, namely 
communication, adaptation, and proficiency. 

The subscale included in the scale aims to uncover teachers' views on various aspects 
related to their attitudes towards refugee students. The communication subscale encompasses 
approaching refugee students without prejudice, behaving with tolerance, understanding them, 
motivating them, etc. The adaptation subscale focuses on ensuring that other parents exhibit 
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a positive attitude towards refugee students, integrating refugee students with other students, 
providing guidance to refugee students, etc. The proficiency subscale is directed at revealing 
teacher opinion regarding feeling proficiency in refugee student education, considering language 
differences not to be a problem, etc. The activities included in the sessions are presented in 
Table 2. 


Table 2 
Sessions of the Attitude Improvement Module Towards Refugee Students 


Session Subject Activity 
Icebreaker Activity 
Session -1 Coordination of Participants Setting Expectations Exercise 


Brainstorming Session on the Concept of 


Presentation of Migration, Refugee, and Attitude Concepts by 
the Researcher 


Session -2 Introduction to Migrationand Metaphor Exercise on Refugee Students 
Refugee Concepts Identifying Factors Influencing Attitudes towards Refugee 
Students (Assignment:Reading books on the theme of 
refugee students by the 3rd session) 
Session -3 Dneetetanaing tie Evaluation of the Read Books 
Background of Student : : : 
_ Lives with Migration Watching Short Films with Refugee Themes 
(Communication) : Making Empathetic Assessments about theFilms and Books 
and Refugee Experience 
Listening to Stories from Refugee Student Parents on Migration 
and Adaptation Themes. 
Session -4 Collaboration with Parents Developing Sample Scenarios on Teacher-Student Adaptation 
(Adaptation) Of Refugee Students Issues Based on the Stories. 
Presenting the Sample Scenarios and Conducting Evaluations 
on Proposed Solutions. 
Providing Information by Experts on Education for Refugee 
Students. 
Session -5 Teachers’ Awareness of Engaging in Discussions about Refugee Student Education 
(Proficiency) Refugee Education (Assignment: Preparation for a debate on the topic "Teacher 
Attitude is/is not a significant variable in refugee student 
education"). 
Established : Conducting the Debate Activity. 
. Relationship between ‘ 
Session -6 ‘ Evaluating the Results of the Debate. 
Teacher Attitudesand , ; 
‘ Closing the Session. 
Student Achievement 


Data Analysis 


RSAS was applied as a pre-test and post-test to control and experimental groups consisting 
of 15 people each. The findings section presents the arithmetic means of the total scores and 
subscales of the RSAS. Skewness and Kurtosis values were analyzed to check whether the data 
exhibited normal distribution (Can, 2019). In this regard, the recommendation that Skewness 
values between -1 and +1 are considered a measure of normal distribution (Morgan et al., 2004, 
p.49) and Kurtosis values equal to 3 in data showing normal distribution (Ozdamar, 2018, 
p.53) were accepted. In the analyses performed, it was revealed that the data were not normally 
distributed, therefore, the tests belonging to the groups were examined with the non-parametric 
tests Wilcoxon Signed Rank Test and Mann-Whitney U Test. 
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In the qualitative phase of the research, the interviews with the teachers and the answers 
to the semi-structured interview questions were recorded and transcribed verbatim. It was stated 
that teachers would be given a code name before the interviews and their real names would not 
be included in the research. Predetermined themes formed the basis of the questions in the 
interview form. Sub-themes were identified by coding the common aspects of the responses 
to the themes. The remarkable statements of the participants regarding the codes are directly 
quoted and included in the tables below. In this regard, the steps of descriptive analysis were 
followed by using predetermined themes and direct quotations under the themes, and the steps 
of content analysis were followed by coding the common aspects of the views under the themes 
(Creswell, 2018; Marriam, 2018). The findings resulting from the descriptive and content 
analysis were compared with the observations made during the research process, the notes 
taken and the forms in which the participants expressed their views about the modules every 
week to determine if there were any contradictions in the findings. 


Validity and Reliability 


In the first part of the research, the quantitative method section, the reliability of the scale 
consisting of three sub-dimensions, namely “communication”, “adaptation”, and “proficiency,” 
was examined. The Cronbach Alpha reliability coefficient was used as the basis for the reliability 
assessment (Can, 2019). When the data regarding reliability were examined, it was found that 
the internal consistency coefficient (Alpha) of the scale was .91, the communication sub- 
dimension was .88, the adaptation sub-dimension was .88, the proficiency sub-dimension was 
.80 (Saglam & Kanbur, 2017). The Cronbach reliability coefficient being in the range of ".80- 
1.00" means that the scale gives reliable results for use in research (Ozdamar, 1999). In order for 
external validity to be acceptable, the opinions of three academics who are experts specialized 
in measurement and evaluation, program development, and refugee student education were 
obtained regarding the size of the study group and the scope of the applied module, and the 
recommendations of the academics were followed. 

To ensure reliability in the qualitative method phase of the research, the "triangulation 
of analysts" strategy (Patton, 2018, p. 556) was used. The data obtained was coded by two 
different people, and the results were compared and revised based on consensus. Additionally, by 
following Patton's (2018, p. 560) participant validation strategy, the findings were presented to 
the participants, and their opinions were sought again regarding whether the findings accurately 
reflected the participants' views. The steps taken throughout the research were explained in 
detail to ensure the transferability of the research to different studies (Marriam, 2018). The 
resulting findings were tabulated to facilitate transfer to different studies. To prevent data loss 
regarding the opinions obtained during the interviews, the interviews were recorded and thus 
contributed to the internal consistency of the research (Creswell, 2018). The data obtained was 
transcribed verbatim. Common themes in the interviews were highlighted and coded, and a 
code book was created (Saglam & Kanadli, 2020). The codes in the code book were presented 
to expert reviewers and revised in line with consensus. 


Research Results 


Findings Regarding the Changes in Teachers' Attitudes towards 
Refugee Students as a result of the Module 


Within the scope of the first problem, five sub-questions were determined, and 
comparative analyzes were made between the groups according to the pre-test and post-test 
results. Comparative descriptive analyzes between groups regarding the RSAS and its subscales 
(Communication, Adaptation, Proficiency) are included in Table 3. 
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546| Table 3 
Descriptive Statistics Regarding Participants' RSAS and Subdimensions (Communication, 
Adaptation, Proficiency) 


Tests Dimensions Groups N Min Max xX SD 

RSAS Communication = 15 2.38 3.63 2.90 10120 

B Adaptation 5 15 2.55 4.00 3.44 11832 

o Proficiency £ 15 1.56 3.56 2.52 15199 

oO 2 15 1.50 2.75 2.29 10630 
uw 

RSAS 7 15 2.17 3.42 2.90 09367 

= CommunicationAdaptation 5 15 2.64 4.00 3.42 10024 

g Proficiency £ 15 1.89 3.22 2.45 11621 

B & 15 1.50 3.50 247 15405 
2 a 

RSAS 15 2.38 3.88 2.95 10175 

B Communication s 15 2.64 4.00 3.47 09927 

} Adaptation = 15 1.78 3.89 2.51 15250 

oO Proficiency & 15 1.75 3.50 2.50 14840 

RSAS 15 1.83 3.46 2.94 10556 

B Communication 2g 15 1.91 4.00 3.39 14406 

* Adaptation 8 15 1.33 3.00 2.51 11251 

& Proficiency 15 1.75 3.50 2.63 12646 


According to the Table, it is understood that there is no significant change in the total 
attitude scores towards refugee students in the experimental group before and after the module. 
While there is a decrease in the "Communication" and "Adaptation" subscale total scores, an 
increase is observed in the "Proficiency" subscale total score. Control group scores appear to 
show overall less change in participants’ perceptions before and after the program compared to 
the other group. The test results examining the relationship between the groups' pre-test data 
are given in Table 4. 


Table 4. 
RSAS Mann-Whitney U Test Results for Pre-test Total and Subdimension Scores by 
Group Variable 


Score Groups N Xorder > order U Z p 
RSAS Experimental 15 15.00 225.00 
Total Control 15 16.00 240.00 105.00 -.311 156 
Pre-test Total 30 
RSAS Experimental 15 15.37 230.50 
Communication Control 15 15.63 234.50 110.50 -.083 934 
Pre-test Total 30 

RSAS Experimental 15 15.77 236.50 

Adaptation Control 15 15.23 228.50 108.50 -.167 868 
Pre-test Total 30 

RSAS Experimental 15 14.43 216.50 
Proficiency Control 15 16.57 248.50 96.50 -.675 .500 
Pre-test Total 30 

*p> .05 
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When the table is interpreted, it is understood that there is no significant difference |547 
between the test scores of the teachers in the groups. In this direction, it can be interpreted that 
the teachers in the groups had similar attitudes towards refugee students before the activities 
related to the module were carried out. 


Table 5 
RSAS Mann-Whitney U Test Results for Post-test Total and Subdimension Scores by Group 
Variable 


Score Groups N  Xorder order U z p 
RSAS Experimental 15 14.57 218.50 
Total Control 15 16.43 246.50 98.50 -.582 561 
Post-test Total 30 
RSAS Experimental 15 15.17 227.50 
Communication Control 15 15.83 237.50 107.50 -.208 835 
Post-test Total 30 
RSAS Experimental 15 14.43 216.50 
Adaptation Control 15 16.57 248.50 96.50 -.668 504 
Post-test Total 30 
RSAS Experimental 15 14.23 213.50 
Proficiency Control 15 16.77 251.50 93.50 -.197 425 
Post-test Total 30 

*p> .05 


According to the Table, it can be seen that there is no significant difference between the 
post-test total and sub-score averages of the participants in the experimental and control groups. 
The results of the relationship between the data obtained from the pre-test and post-test of the 
groups are given in Tables 6 and 7. 


Table 6 
Wilcoxon Signed-Rank Test Results for RSAS Experimental Group Pre-test vs. Post-test 
Scores 


Score Groups N Xorder >order Zz p 

RSAS Decreasing 8 8.13 65.00 

(Pre-test-Post-test) Increasing 7 7.86 55.00 -.284 176 
Equal 0 
Total 15 

RSAS Decreasing 7 7.14 50.00 

Communication Increasing 6 6.83 41.00 -.316 152 

(Pre-test-Post-test) Equal 2 
Total 15 

RSAS Adaptation Decreasing 7 9.36 65.50 

(Pre-test — Post-test) Increasing 8 6.81 54.50 -.313 154 
Equal 0 
Total 15 

RSAS Proficiency Decreasing 5 6.70 33.50 

(Pre-test-Post-test) Increasing 8 7.19 57.50 -.842 400 
Equal 2 
Total 15 

*p> .05 
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548 According to the Table, it is revealed that there is no significant difference between 
the pre-test and post-test results of the total and sub-dimension scores of the attitudes of the 
teachers in the experimental group. When the rank average scores are examined, a decrease is 
seen in the general average and in all dimensions, while an increase in attitudes towards the 
"Proficiency" sub-dimension has emerged. 

In this regard, it is understood that the Refugee Student Attitude Improvement Module 
impacts attitudes towards the "Proficiency" sub-dimension but does not significantly impact 
general attitudes towards refugee students in the experimental group. 


Table 7 
Wilcoxon Signed-Rank Test Results for RSAS Control Group Pre-test vs. Post-test Scores 


Score Groups N Xorder order z p 
RSAS Decreasing 5 10.10 50.50 
(Pre-test —Post-test) Increasing 10 6.95 69.50 -.541 089 
Equal 0 
Total 15 
RSAS Decreasing 7 7.64 53.50 
Communication Increasing 7 7.36 51.50 -.063 .950 
(Pre-test —Post-test) Equal 1 
Total 15 
RSAS Decreasing ) 7.70 38.50 
Adaptation Increasing 8 6.56 52.50 -.489 624 
(Pre-test -Post-test) Equal 2 
Total 15 
RSAS Decreasing 2 9.00 18.00 
Proficiency Increasing 8 4.63 37.00 -.975 330 
(Pre-test — Post-test) Equal 5 
Total 15 
*p> .05 


According to the Table, no significant difference was observed in the total and sub- 
dimension attitude scores of the participants in the control group towards refugee students 
before and after the implementation of the module. The lack of a significant difference can be 
attributed to the fact that no program was applied to the control group. 


Findings Regarding the Views of Teacher Participants in the Module 


The questions in the interview form consist of themes related to the teachers’ perspectives 
on the planning and scope of the module, their own contribution, the target audience in its 
implementation and the reasons behind it. The tables are coded based on the analysis of the 
answers to these questions. Participant views regarding the coded expressions are presented 
with direct quotes right below the tables. 
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Table 8 
Teachers' Views on Planning and Scope of the Attitude Improvement Module Towards 
Refugee Students 


Theme Organization and Planning 
Sub-themes Codes 
Process The duration of the module is sufficient. 


Before the module training period starts and after the training period ends. 
The idea exchanges during the module process are beneficial. 

The duration of the module is insufficient. 

The module can be implemented during seminars. 


Participants Parents should participate as participants in all sessions of the module. 
The benefits of experts participating in the module 
Ministry of Education (MoNE) administrators should participate as 
participants in the module. 
Psychologists should participate as participants in the module. 
Educators working in Syria should participate as participants in the module. 


Scope The films and books included in the module have created awareness. 
Deficiencies in the module can be detected and updated. 
Parent visits can be organized within the scope of the module. 
The experimental nature of the module made the research realistic. 
We couldn't focus on education due to criticizing policies developed in 
relation to the subject matter of the module. 
Practical applications can be organized within the scope of the module. 
Children’s games can be included in the scope of the module. 


According to the Table, the teachers who shared their views about the module process 
found the 6-week period sufficient. Teacher T6's statement, "J think the module is balanced in 
terms of duration. If it was long, it would be boring, if it was short, it would be insufficient." 
reflects the majority's point of view. 

When teachers' views about module participants are examined, it is seen that parent 
participation is emphasized. Teacher T9's emphasis on the importance of parents in refugee 
education was, "J think parents should be involved in all modules. What is their perspective on 
the school? What are their expectations? We should discuss these more." He attracted attention 
with his expressions. 

When teachers' views about the scope of the module are examined, it is understood that 
they find the scope useful but also point out areas that can be improved. In this regard, the 
views of T5 and T12 were "It can be improved by doing, experiencing and trying. The content 
can be updated in the end-of-year evaluations, we can decide together" and "Especially group 
games bring Syrian and Turkish children together and integrate them. A section about this can 
be added." came to the fore. 
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Teachers’ Views on the Contribution of the Attitude Improvement Module Towards Refugee 
Students to Teachers 


Theme Contributions of the Module to Teachers 


Sub-Themes Codes 


It prompted the questioning of the approach towards refugee students. 
It instilled an empathetic approach towards refugee students. 
It raised awareness about the lives of refugee students. 


Made a Positive 
Contribution 


It provided motivation for the education of refugee students. 
It did not contribute due to prejudices. 
It did not contribute due to the module's ineffectiveness. 


Didn’t Make a 
Positive Contribution 


According to the Table, the teachers experienced positive changes in their lives after 
the module, such as the development of questioning skills, empathic approach, awareness, 
motivation and positive transformations. However, some teachers reported that they did not 
experience any change due to their existing biases or the perceived ineffectiveness of the 
module. 

Expressing his views on the positive impacts of the module, Teacher T11 stated that they 
approached the students with more empathy in refugee student education with the following 
words: "For example, instead of shouting and reacting when the students failed, I stayed calm 
and tried to understand why they did not understand something (language problem? living 
conditions at school). "Teacher T1 explained how they were motivated during the module: "7 
felt helpless, but I realized that I was not alone in the world, and based on our shares, I gained 
the courage to believe that I could do it too." He expressed it with his words. 

Teacher T7, one of the teachers who stated that the module did not contribute to their 
lives, expressed her existing prejudices as follows: "There has been no change in my views. I 
think there is conditioning and prejudice, we cannot break them." 


Table 10 
Participants' Views on whom Should the Attitude Improvement Module towards Refugee 
Students be Implemented 


Theme To whom it should be implemented 
Sub-themes Codes 
All teachers who It should be implemented for teachers in all subjects working inrefugee-dense areas. 


haverefugee students. It should be implemented for newly appointed teachers inrefugee-dense areas. 


Undergraduate It should be implemented for teachers pursuing undergraduateeducation 
students. 


School Administrators It should be implemented for school administrators. 


When examining the Table, it can be observed that teachers expressed their views on the 
necessity of implementing the module for teachers in all disciplines working in refugee-dense 
areas, as well as for newly appointed teachers, pre-service teachers, and administrators. 
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Among the teachers who emphasized the importance of refugee student-dense areas, 
Teacher T12's statement stood out: "This module should have been implemented in provinces 
with high numbers of refugee students, such as Hatay, Kilis, Gaziantep, in the southern part of 
the country, and for all disciplines. Because due to the high number of refugee students, they 
cannot integrate into the education system." 

Teacher T4 expressed their views on the education to be provided by newly appointed 
teachers: "Newly appointed teachers need it, for example, because they will struggle more. We 
have worked for a certain number of years, we have experience. We have worked in regions 
where the native language is different, yet we struggled." In addition to all these requirements, 
Teacher T13 emphasized the participation of administrators in the process: "Education is a 
team effort. I think administrators should also participate. Even if administrators tell me how 
well they understand me, it won't be beneficial if they don't sit down and talk with me.” 


Table 11 
Teacher Views on the Quantitative Results of the Attitude Improvement Module towards 
Refugee Students 


Theme Teacher Views on the Quantitative Results 
Sub-theme Codes 
Reasons for No Change Prejudices towards refugee students 


In Overall Attitude Averages Feeling of hopelessness towards refugee student education 
Inability to accept the presence of refugees 
Language barriers with refugee students 
High number of refugee students 
The impacts of the negative opinions shared within the experimental group during the 
module process 


Solutions Regarding Education on refugee student education should be provided. 

The Reasons Country policies regarding refugee student education should be improved. 
Incentives should be provided to teachers who teach refugeestudents. 
Parents should be included in the education of refugeestudents. 


When the Table is examined, it is observed that teachers harbor prejudice against refugee 
students, feel hopeless about refugee student education, cannot accept the presence of refugees, 
face language problems with students, and negative views expressed by teachers during the 
module process. Due to these underlying reasons, it is understood that there is no change in the 
overall attitudes towards refugee students before and after the module. Teacher T9 expressed 
their concerns about cultural differences: "They are far from our culture, and I'm afraid to visit 
their homes. We have big prejudices. I don't have the courage to go to their homes and talk." 

Teachers also mentioned being influenced by negative views expressed by some teachers 
during the module sessions, as stated by Teacher T6: "During the module process, we may have 
been influenced by the negative opinions of our teachers." When examining the views on how 
teachers' attitudes can change positively, Teacher T2 expressed what areas they need education 
on: "How to approach students? How to communicate with parents? How to find common 
ground? Training can be provided on these topics." Teacher T11 highlighted the importance 
of language in state policies concerning refugee students: "Syrian students have language 
deficiencies. Language proficiency should become a government policy. They should not start 
school without language proficiency. The government should implement sanctions regarding 
this." 
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Discussion 


In the research, it was aimed to improve the attitudes of teachers towards refugee students 
and to contribute to professional development studies on refugee student education by carrying 
out activities designed within the scope of the "Attitude Development Module towards Refugee 
Students" with the teachers in the experimental group. In this context, the scale used in the 
study and forming the basis of the module was applied as a pre-test before the activities in the 
module were carried out and as a post-test after the activities in the module were carried out. 
Afterwards, the impacts of the module on the attitudes of the teachers were examined in line 
with the opinions received from the teachers. 

When the descriptive statistics for the attitudes of the teachers after the implementation 
of the activities in the module were examined, there was no significant change in the total 
arithmetic mean of the attitudes of the teachers in the experimental group towards refugee 
students. However, it was concluded that the applied module had a positive impact on the 
"proficiency" sub-dimension, which includes behaviors related to being proficient in refugee 
education but was ineffective in encouraging behaviors related to impartial communication and 
tolerance towards refugee students. This finding is also supported by previous studies showing 
that teachers' professional proficiency and beliefs can potentially be improved through training 
programs designed for the education of refugee students and classroom management (Babahan, 
2016; Baéakova & Closs; Erdem, 2017; Kardes & Akman, 2018; Keskin & Okeu, 2021; Sakiz, 
2016; Tastekin et al., 2016). 

In addition, the results showing that there is no significant difference between the post- 
test scores show that there is no significant change in attitudes towards refugee students even if 
any training is applied to one of these two homogeneous groups. Similar findings were reported 
in Habib's (2020) study aiming to improve teachers' attitudes towards refugee students and in 
Arthur (2005) and Kovinthan's (2016) studies examining the effectiveness of pre-service and 
in-service education. These findings emphasize the resistance of teachers' attitudes towards 
change and the need to reveal the underlying reasons for this resistance. 

When teachers' views about the module were examined, the majority stated that they 
were satisfied with the planning and duration of the module, the exchange of ideas and 
expert participation throughout the process. However, they emphasized the need for greater 
participation of refugee student parents and MEB administrators in the education process. 
Research on the attitudes of refugee student parents towards education reveals that they mostly 
do not attend meetings and show little interest in their children's education (Kardes & Akman, 
2018; Nar, 2008; Aykin, 2017). Language barriers also contribute to the communication gap 
between parents and teachers (Kara, 2022). In addition, research findings show that, despite 
the necessity of close relations between teachers and the MEB in the education of refugees 
(Shaherhwasli et al., 2021), teachers often cannot receive the necessary support from relevant 
people and organizations (Aykin, 2017; Taskin & Erdemli, 2018). 

Regarding the contributions of the module to teachers, expressions emphasizing that 
they have started to question the education they mostly apply to refugee students, approach 
students more empathetically, and with increased awareness, their motivation has also risen, 
have come to the forefront. However, statements indicating that the module did not contribute 
due to prejudices are also present. In the relevant studies, when examining Memis's (2015) 
research in Kilis province, it was found that 67% of the participants had prejudices that Syrians 
harmed the local population. In the study by Ozorug and Sigirtmag (2022) in Gaziantep 
province, findings suggested that teachers experience motivation loss due to communication 
and violence problems with refugee students. However, in a result that does not overlap with the 
emerging findings, Babur (2021) revealed in Erzurum that teachers already have a high level of 
empathetic tendencies towards multicultural education. In this regard, considering the ratio of 
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Syrian refugees to the population in Erzurum as 0.13%, in Kilis as 33.62%, and in Gaziantep as 
17.04% (15.06.2023, www.goc.gov.tr/gecici-koruma5638), it can be said that in provinces with 
a low number of refugee students, teachers express more positive views about refugee students 
without the need for any education. 

Regarding whom the module should be applied to, views have emerged suggesting that it 
should be applied to all teachers with refugee students and at the undergraduate education level, 
including administrators. In various studies, it is emphasized that all teachers with refugee 
students feel inadequate in approaching students from different cultures (Polat & Rengi, 2014), 
solving their problems (Uzun & Biitiin, 2016), and have not received any training on refugee 
student education (Aykin; 2017; Er & Bayimdir, 2015). Therefore, it can be argued that all 
teachers with refugee students need to be supported with training on refugee student education 
through the implemented module. 

In line with the views regarding the quantitative results of the module, the reasons for the 
lack of change in the overall average of teachers' attitudes are understood as "prejudices against 
refugees, feelings of hopelessness, inability to accept refugee students, language problems with 
students and their large numbers, as well as teachers' opinions negatively affecting each other 
throughout the module process." While prejudices against refugee students among teachers 
have been discussed before, it is evident that the feeling of not being able to accept refugee 
students due to these prejudices is a significant factor negatively affecting teachers’ attitudes. 
In fact, the refugee policy pursued by the Republic of Tiirkiye, shaped in the 2011s towards 
refugees returning to their homelands, has been updated in recent years to emphasize their 
staying and adapting to the country (Efe et al., 2022; Yasar et al., 2020). This situation has led to 
a dilemma among teachers regarding whether refugees will "leave or stay" and has contributed 
to the feeling of not being able to accept refugees. Additionally, with the start of education 
for nearly 700,000 Syrian students following the integration decision that came into effect in 
2016 (Ozdemir & Aypay, 2022), the increasing density of the refugee student population and 
the adaptation problem experienced in the social area in this direction (Arar, 2022; Yasar et al., 
2020; Tastan et al., 2017) have led to teachers developing prejudices and displaying negative 
attitudes towards refugee students. Furthermore, research has indicated that language and 
communication problems with refugee students are among the main issues hindering teachers 
from developing positive attitudes towards them (Coban, 2022; Kardes & Akman, 2018; Levent 
& Cayak, 2017; Nar, 2008; Oikonomidoy, 2010; Yurdakul & Tok, 2018; Toprakg¢1 & Yazic1, 
2021). 


Conclusions and Implications 


According to all these results, it was revealed that the module developed by the 
researchers improved teachers' attitudes in terms of the proficiency sub-dimension but was 
ineffective in improving their attitudes within the scope of the communication and adaptation 
sub-dimensions. In this context, it can be said that different studies are needed to improve 
teachers' communication and adaptation sub-dimensions, and that teachers' beliefs about their 
proficiency in refugee education can be improved with studies similar to the developing module. 

When the teachers' views on the impact of the module are examined, it is understood 
that students resist developing positive attitudes towards refugee students (communication and 
adaptation). The reasons underlying this resistance include teachers' prejudices towards refugees 
(Arab culture), lack of education on refugee student education, difficulty in communicating 
with refugee students and parents due to language problems, refugee students feeling hopeless 
about their learning abilities, high density of refugee students in classes, isolation of students 
by the MEB during the adaptation process, and lack of a stable policy towards refugees in the 
country. It was revealed that teachers who stated that the module made a positive contribution to 
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them gained awareness and empathy towards the lives of refugee students and refugee student 
education after the module. In addition, the findings include opinions that the module should 
be applied to teachers studying at the undergraduate level, current teachers and administrators. 
At the same time, it is among the expectations of the teachers that the MEB should support 
teachers in this regard and produce policies that will allow them to improve themselves in the 
education of refugee students. 

In the context of the findings, it can be said that strategic steps should be taken to support 
teachers so that refugee students can adapt to the education system, contribute to the quality 
of education and continue their lives as useful citizens of society. These steps should first be 
started by including the subject of “refugee student education” in undergraduate teacher training 
programs and thus improving the proficiency of teachers. In addition, special training programs 
should be organized for teachers who are still on duty to specialize in refugee student education, 
and practices should be designed to overcome factors (such as political insecurity and prejudice) 
that prevent teachers from developing positive attitudes towards refugee students. Teachers who 
are dedicated to educating refugee students should be encouraged with appreciation awards, 
and module-like studies should be developed and implemented to increase the attitudes and 
motivation of teachers, where refugee students are densely populated. 

The disproportionate increase in the refugee student population in schools makes it 
difficult for students to adapt to school life and the education system and to learn the language 
of the society they live in. Therefore, efforts should be made to reduce the number of refugee 
students in classes in order to provide better learning environments. At the same time, preschool 
education should be made compulsory to support language acquisition among refugee 
students, and priority should be given to measures such as providing Turkish language lessons 
in preschool education. In addition, MEB administrators should actively participate in the 
education processes for refugee students and try to involve parents in education. International 
partnerships should be established to make all these steps permanent and to develop long-term 
education strategies for refugee students. 

When the literature is examined, it is understood that the majority of the studies describe 
the attitudes of teachers towards refugee students. In the research conducted, it is thought that 
the research will provide a different perspective to the studies in the literature in terms of taking 
concrete steps to support teachers in improving attitudes towards refugee students and obtaining 
the findings based on real-life experiences in the research process. In this context, it can be said 
that the rich data set obtained will contribute to the studies of policymakers and researchers who 
are working to make education systems with a high density of refugee students more qualified. 
However, in the study where all these findings emerged, the study group was working in Kilis 
province, and the scope of the designed module was limited in terms of the sub-dimensions 
in the scale used. Considering the limitations of the study, it is hoped that future studies will 
be developed by taking inspiration from the module and that the developed modules will be 
implemented in all provinces, especially in provinces with a high concentration of refugee 
students, and with a larger number of participants. 
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Abstract 


In today's world, where the internet-based digitalization process has gained momentum, increasing the 
quality of learning in the educational process can be achieved by associating the transferred achievements 
with current topics and news in written and visual media by the teacher of the course, thus increasing 
the attention level of the learners in the learning environment. This situation, which shows the impact of 
the agenda on the educational process, increases the awareness level of the learners regarding the time 
period in which they live, the environment and the events that occur. In this direction, this study aimed 
to identify and evaluate the practices in the education process in the context of agenda setting, in line 
with teachers’ opinions. This study, which was carried out with the phenomenology pattern, one of the 
qualitative research methods, was conducted with 30 teachers working in public schools. The data of 
the research were collected with a semi-structured interview form. The data obtained was analyzed with 
content analysis. As a result of the study, it was determined that the practical reflections of the activities 
prepared by the teachers based on the agenda setting theory were not sufficient in the context of learning. 
Keywords: Agenda setting, educational practice, phenomenological design 


Introduction 


Important developments in science and technology from the past to the present have 
brought humanity to a new era. This period, shaped by science and technology, differs from 
the previous periods in many contexts. This period, especially with the developments in 
communication technologies, has made geographical distance, which is the biggest obstacle in 
front of information and communication, a relative concept. Today, people living in different 
continents have almost equal opportunities to reach the same news or information. This effect 
of technology, which wraps the whole world like a spider web, is increasing day by day. This 
situation can be associated with the dynamic structure of communication technologies. As a 
matter of fact, the functions of mass media, whose primary function was to inform and inform, 
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have diversified over time. Today, the media has a function that can direct and influence the 
feelings and thoughts of the individual regarding various facts and events. As a matter of fact, 
Bernard Cohen's (1963) saying “The media is successful in telling us what to think about, not 
what to think” is about this issue. The dominance of the media over individuals also paved the 
way for its emergence as a political power. The ability of political power to control and direct 
individuals is in the form of influencing the individual with the agenda they set. Every day, 
individuals are exposed to an artificial agenda determined by pressure groups and served by the 
media. This situation causes the individual to perceive that the agenda and content served are 
adopted and approved by the majority of the society. In the face of this situation, the individual 
avoids expressing their feelings and thoughts, and over time, he becomes a passive follower of 
the agenda. This issue has been under the lens of communication researchers for nearly half a 
century. Communication researchers address this process, which has not been tested empirically 
but includes causal relationships, under the title of agenda-setting theory. Under this title, the 
researchers included the general hypothesis of agenda setting, the importance of the hypothesis, 
the functional aspect and the effect aspect. Considering the impact of the media in the context of 
the individual and society, it can be said that it is important to understand this theory. 


Literature Review 


Agenda setting theory, which is accepted as a criterion in the evaluation of applications 
in the educational process, has an important place in today's world, where the use of digital 
products is common. With this awareness, the scope of this theory is detailed in the study 
carried out by the researchers. 

Agenda setting theory is based on the understanding that people are informed thanks to 
the information given by the mass media and that people learn which events are more important 
with the agenda set by the media. Agenda setting; It is based on the understanding that the 
perception of the members of the society about the importance of certain issues is shaped by 
the importance they attach to that issue by the means of communication (McQuail & Windahl, 
1997; Obiaje, 2022; Wanta, 1997). With the rapid changes and developments experienced with 
globalization in recent years, the digitalization process and social media not only change the 
traditional communication environment but also bring new changes in agenda setting (Tural, 
2023; Zhang et al., 2024). This situation reveals the influence of mass media and media in 
agenda setting. As a matter of fact, agenda setting theory has an important place in mass media 
research and practices (Obiaje, 2022). In the 21st century, the media and the mass media, which 
are influential on agenda setting, make their impact on individual and social life intensely felt 
and play the role of the main determinant of social change that also directs the life of the 
individual. Such a situation brings with it an increasing interest in determining the effect of 
mass media on individuals and society. In addition, it provides some concepts to come to the 
fore in explaining the effect of the media shaped by the mass media on the individual and the 
total. Agenda setting is among these concepts. This concept is often used synonymously with 
the concept of forming public opinion. But the two terms have different meanings. In this 
respect, revealing the difference between the two concepts may be useful in the context of 
understanding the concept of agenda setting. 

The concept of public opinion is a concept that has been tried to be defined by many 
researchers. As a matter of fact, the American scientist Harwood Childs reviewed all written 
sources in 1965 and compiled about fifty definitions of the concept of public opinion (Neumann, 
1998). From this date to the present, the number of definitions has increased in parallel with 
the influence of public opinion on individual and social life. When the ethnic origin of the 
concept is examined, it is seen that it is derived from the words publicus and opinion in Latin 
and entered western languages, while it is expressed with the words “public opinion” in English 
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(Atabek, 1998). When the words public and vote that make up the concept are examined, it can 
be said that they essentially reflect the content of the concept. Namely, the concept of public is 
used to mean "open to everyone", and the concept of vote is used to mean "common opinion" 
(Neumann, 1998). 

When the broad meaning of the concept is examined; It can be defined as the "general 
judgment" within a certain period about a subject that concerns the public. However, this 
definition does not mean that all members of the society have reached a consensus on the 
relevant issue. As a matter of fact, the structure of the society that includes different groups and 
the fact that each group has different attitudes and values makes it possible to disagree on the 
current issue. In a narrow sense, public opinion is the average of the ideas that social groups or 
individuals who have the opportunity to make their voices heard by means of mass media want 
to convey to the political authorities (Daver, 1993). When the formation of public opinion is 
examined, it can be mentioned that the emergence of an event or situation that may be perceived 
as a problem by some groups in the society, the formation of an opinion to evaluate this situation 
or event, the formation of attitudes in line with these views, and the transformation of attitudes 
into behavior (Vural, 1999). In line with this process, it can be said that attitudes and verbalized 
opinions are an important factor in forming public opinion. Attitudes, defined as affect for or 
against a psychological object (Thurstone, 1931), embody positive or negative reaction. The 
individual develops a cognitive, emotional and behavioral response to a situation, event or 
object on the axis of his attitude. Opinions, which can be defined as the verbal expression of 
attitudes, focus on the uncertainties and problems in a particular situation, unlike attitudes. In 
this context, they have a more rational structure than attitudes (Oskay, 1974). 

The concept, expressed in English as "Agenda Setting", is considered as the first step in 
creating public opinion. The news media have a significant impact on drawing public attention 
to issues that its members consider important. However, the news media makes an effort to 
attract the attention of the public to certain aspects of the issue rather than to the whole. This 
effort is called the agenda-setting role of the news media (Salman, et al. 2016). In this context, 
agenda setting is the creation of public awareness and interest about issues highlighted by the 
news media on the public agenda (Obiora et al., 2024). Unlike in the process of forming public 
opinion, there is no change in the attitude or behavior of the individual in agenda setting. In this 
process, it is only possible to raise awareness about a certain situation, phenomenon or event in 
the individual. It can be said that the transformation of this awareness created in the individual 
into an attitude and the observation of behavior change in this direction constitute the content 
of the public opinion formation process. 

In the context of agenda setting theory, the effort to create individual and social awareness 
is one of the most prominent practices in education, as in all areas of life. In particular, the use 
of internet-based digital tools in the learning environment has brought about the reflections 
of this theory. Social networks, which have initiated a new agenda-setting process by being 
incorporated into the traditional agenda-setting structure, are increasingly influencing the agenda 
of the media and politics with the advantage provided by their structural features (Giing6r, 
2021). It is also stated that social media significantly affects this theory (Gilardi et al., 2022). 
The individual and social orientation of the mass media, which constitutes the media and whose 
influence is increasing day by day in all areas of life, has more negative but also positive effects. 
These positive and negative effects can occur by making use of the current products offered by 
the media during the education process. Determining the direction of these effects according 
to the purpose of use depends on the teacher, who is the lecturer of the course. Therefore, in 
today's world, it can be said that the agenda-setting theory is important for the individual whose 
whole life, including education, is directed by the media, to become an individual with high 
awareness by making the best use of this situation as a conscious learner. In this study, which 
was carried out to determine the reflections of this theory in the education process, evaluations 
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regarding the positive and negative reflections of agenda setting were included in the study. 
As a matter of fact, since teachers aim to raise active citizens who follow the agenda and have 
social awareness, this study is expected to contribute to the literature with teachers' opinions in 
the context of agenda setting theory of practices in the education process. 


The study sought answers to the following questions: 

1) What are your thoughts about the impact of agenda setting theory on practices in the 
education process in Turkey? 

2) What are your thoughts about the contribution of courses taught with practices and 
activities based on agenda setting theory to the learning process of students? 

3) What do you think are the issues based on agenda setting that cause perception 
illusions in the education process? 

4) What are your suggestions regarding the preparation and use of agenda-setting-based 
activities and practices in the lessons during the education process? 


Research Methodology 


In this study, the practices in educational processes were evaluated based on teacher 
opinions within the context of agenda-setting theory. As a research method, phenomenology, 
one of the qualitative research approaches, was employed. 


Research Design 


This study was designed as a phenomenological research. Phenomenological design 
focuses on situations that we are aware of but do not have in-depth and detailed knowledge. Facts 
can appear in various forms such as events, experiences, perceptions, concepts and situations 
in the world we live in. Phenomenology is a sufficient ground for research on subjects that are 
not completely known but not fully understood (Gé¢er, 2014; Groenewald, 2004; Kocoglu, 
et al., 2022). In this model, the researcher deals with the personal (subjective) experiences of 
the participants and explores the perceptions of individuals and the meanings they attribute to 
events. Phenomenology is a descriptive research method. Therefore, it only aims to describe 
the facts and does not generalize (Koopman & Koopman, 2017). In this study, the research was 
designed with a phenomenological pattern as it was aimed to reveal the detailed opinions of 
teachers regarding this situation by evaluating the practices in the educational process in the 
context of agenda setting theory and teachers’ opinions. 


Participants 


The study group of this research consists of 30 teachers. 30 teachers working in public 
schools in Malatya and Elazig provinces in Turkey. The data collection process continued until 
sufficient and satisfactory information was obtained, and the study group was completed after 
the interview with the 30th participant. Ten of these teachers work at primary school, 10 at 
secondary school and 10 at high school level. The purposive sampling method was used in the 
determination of the study group due to the condition of working in public schools. The teachers 
who contributed to the study with their opinions participated in the study on a voluntary basis. 
Before the study, the participants were informed about the subject by the researchers. 

The sociodemographic characteristics of the teachers forming the study group are as 
follows: 
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Table 1 565 
Sociodemographic Characteristics of the Teachers Forming the Working Group 


Characteristic Description 
Gender 18 female, 12 male 
Age Range 25-50 years 
Professional Experience 5-25 years 


All teachers have at least a bachelor's degree, 12 


Edupalon Levy teachers have a master's degree 


Data Collection Instrument 


A semi-structured interview form developed by the researchers was used to collect the 
study data in order to evaluate the practices in the education process in Turkey in line with 
the opinions of the teachers on the agenda setting axis. While developing the semi-structured 
interview form, questions related to the research topic were determined first. Focused questions 
that are easy to understand, open-ended, avoiding guidance and multidimensionality were 
selected and arranged logically (Kocoglu & Egiiz, 2019; Yildirm & Simsek, 2013). In order 
to ensure the content validity of the interview form used in the study, the opinions of the 
measurement and evaluation experts working at the Indnii University Faculty of Education 
were taken. It was stated that the form prepared by the experts was suitable for the purpose of 
the research and the questions were understandable. In addition, when the form was examined 
in the context of the content of the questions, it was concluded that it was in a balanced way. 
In this context, it can be said that the form as a whole and the questions in the form serve the 
purpose and represent the content of the subject. In line with the opinions and suggestions of 
these experts, the semi-structured interview form was given its final form. The form consisting 
of 4 questions was applied and the obtained data were analyzed. 


Data Analysis 


In this research, the data obtained through semi-structured interviews were subjected 
to content analysis to systematically examine the frequency and patterns of themes within the 
responses. This method was selected to facilitate a structured yet flexible analysis of qualitative 
data, allowing for an in-depth exploration of the participants' insights and experiences. This 
technique helps identify the main themes and sub-themes of the research, thereby aiding in 
understanding the participants' experiences and thoughts. The data collection process was 
conducted through face-to-face interviews with the selected participants. These interviews 
were carried out using a pre-prepared semi-structured interview form. This form contains open- 
ended questions that allow participants to freely express their thoughts on specific topics. Each 
interview was conducted in an environment where the participant felt comfortable and secure, 
and each interview lasted approximately 45 minutes. 

First, the audio recordings of the interviews were transcribed into written form. Then, 
these transcripts were thoroughly examined, and the main themes and sub-themes were 
identified. During the theme identification process, participants' views were grouped into 
specific categories. Each theme was created based on the similarities in the participants' 
responses. The identified themes and sub-themes were visualized using tables created in 
a computer environment. These tables categorize the number of participants discussing the 
themes and similar views into four categories (O.1, O.2, 0.3, and O.4 Opinion and ranking 
number). This approach clearly illustrates the intensity and diversity of participant views on a 
particular theme. 
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The analysis process was conducted independently by the researcher and two experts in 
the field of social studies at Firat University and Inénii University. Consensus and discrepancies 
between the experts and the researcher were identified for each theme. This process played a 
critical role in ensuring the accuracy and consistency of the evaluated themes. Using the formula 
provided by Miles and Huberman (1994), the agreement rate in the analyses was calculated to 
be 89%. This high level of concordance significantly enhances the reliability and validity of the 
analyses. 


Research Results 
The Situation Regarding the Effect of Agenda Setting in Educational Practices 
The answers given by teachers regarding the impact of agenda setting theory on 
educational practices were analyzed and the findings obtained are given in Table 2 in the form 


of sub-themes. 


Table 2 
Teachers' Perceptions of the Reflections of Agenda Setting in Education 


Theme 1: Reflections of Agenda Setting in Educational Practices 


Sub-themes 


The positive impact of agenda setting theory in 0.1. Program change 
educational practices 


0.2. Agenda-based attention 


0.3.Digitalization and virtualization in education 


0.4. Media-based sampling 


The negative impact of agenda setting theory in 0.5.Content immutability 
educational practices 0.5.Prejudice 


BLM] Dm! as!wNlols 


Considering the Table 2 containing the findings obtained from the answers given 
by the teachers who constituted the study group to the first question in the semi-structured 
interview form, it is seen that remarkable findings have been reached. In particular, the fact 
that the teachers had different opinions on the subject revealed the diversity in the findings. 
It is observed that the most important finding that comes to the forefront is the evaluation of 
"digitalization and virtualization in education" as a reflection of the agenda setting theory in 
the education process. The opinions of the teachers, which exemplify Table 2, in which many 
similar important findings were obtained, are given below. 


“I didn't know what agenda-setting theory was until I talked to you. This has made me very 
confident in my assessment of its effects on the educational process. However, I would like to answer your 
question based on what I heard from you and read on the internet. I am a five-year primary school Life 
Studies teacher. While explaining the subjects to the children in my class, I sometimes make transfers by 
imitating the characters of the TV series. I think that this situation attracts their attention more and has 
an effect on their listening to the lesson. That's why I believe that this theory definitely has an impact on 
educational practices." (Primary School, Female Teacher, 9) 

“T think that this theory should definitely be used in education. Contrary to our country, I see that 
it is used in the countries that make up the western world. I think it has no effect on our education system 
because we have been taught the same content for years with similar methods without changing it.” (High 
School, Male Teacher, 4) 
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Contribution of Agenda Setting Theory to Educational Practices 567 


The answers given by the teachers regarding the contribution of the practices and 
activities prepared on the basis of the agenda setting theory to the educational practices were 
analyzed and the findings obtained are given in Table 3 in the form of sub-themes. 


Table 3 
Teachers' Perceptions Regarding the Contribution of Agenda Setting to Learning 


Theme 2: Contribution of Agenda Setting in the Learning Process 
Sub-themes f 
0.1. Media assisted learning 


Positive impact of the learning process 0.2.Individual learning and repetition 


0.3.Creating a multi-learning environment 


0.4.Priority and importance in learning 


0.5.Organized and cooperative learning 


Negative impact on the learning process = 0.6. Cognitive transfer and Guidance 


OR ee ee oe eo) 


0.7. Illusion of perception 


When the findings obtained as a result of the content analysis and given in Table 3 
are examined, it is observed that the teachers who make up the study group differ under the 
themes of "Yes" and "No" in terms of influencing the learning of learners by the practices and 
activities prepared on the basis of agenda setting theory and used in education. Particularly, it 
is seen that the sub-themes expressing that agenda-setting-based activities offer the opportunity 
of "individual learning and repeating what they have learned and a multi-learning environment 
that enables many senses to be active in learning" come to the fore. Including the sample 
opinions of the teachers who contributed to the study with their perspectives on the relevant 
findings may contribute to the process of making sense of the sub-themes. These views are 
exemplified below. 


“T think that the practices and activities prepared on the basis of the agenda-setting theory have 
a negative impact on the learning process of students, rather than contributing to them. Due to this 
theory, it is common for us to encounter a learner mass in classrooms that perceives what I teach in 
class differently and as directed by the media. I think this situation causes an illusion of perception in 
students.” (Middle School, Female Teacher, 25) 


“As a social studies teacher, the use of media and mass media in learning environments can 
provide concrete, meaningful and permanent learning with the acquisition-based transfers in the 
programs. That's why I think agenda-setting theory based on media-based transmissions is important in 
the learning process.” (Primary School, Male Teacher, 30) 


The Situation Regarding the Issues Caused by Illusions of 
Perception in the Education Process 


The answers given by the teachers regarding the agenda-setting-based issues that are 


effective in the illusion of perception during the education process are analyzed and the findings 
are given in Table 4 in the form of sub-themes. 
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Table 4 
Teachers' Perceptions About the Issues that Cause the Illusion of Perception 


Theme 3: Agenda Setting in Education and the Illusion of Perception 


Sub-themes 


0.1. Subjects with advertisement content 


0.2.Political issues 


0.3.Psychological issues 


0.4.Socio-cultural issues 


0.5. Value-based issues 


BR] ml wl wl] wm] al SX 


0.6.Historical issues 


Considering the issues that cause the illusion of perception on the students in the learning- 
teaching process of the agenda-setting theory in education, it is understood that the members 
of the study group do not have similar perceptions about the theory. This situation can be seen 
in Table 4, which causes the diversity of the subject on the illusion of perception. Examples of 
teachers' views on this situation are given below. 


“I think it is very important to convey the contents prepared in line with the principle of timeliness 
in the education process in a meaningful way. As a secondary school teacher, I think this importance 
has increased even more for my level. In line with the agenda-setting theory, which is based on the 
transmission of the mass media on the basis of this principle, students who frequently use written, visual 
and social media in their studies related to the course, in my opinion, have more illusions about historical 
issues. The TV series that have been in the visual media for the last few years are the best examples of 
this.” (Middle School, Male Teacher, 1) 


“Socio-cultural issues that cause cultural degeneration and alienation are at the forefront of the 
issues that cause the illusion of perception in the transfers based on agenda-setting in the education 
process. The transfer of these subjects in a way that is disconnected from the geography and social 
structure may cause the learners to become lonely.” (High School, Male Teacher, 20) 


Suggestion Regarding Agenda-Setting-Based Activities and Practices Status 
The answers given by teachers regarding the use of agenda-setting-based activities and 
practices in lessons during the education process were analyzed, and the findings obtained are 


given in Table 5 in the form of sub-themes. 


Table 5 
Perceptions Including Teacher Suggestions for Agenda-Setting Activities 


4th Theme: Agenda Setting in Education and Teacher Suggestions 
Sub-themes f 
0.1. It should not contain any redirects 10 


0.2. It should be suitable for the level of the student 


0.3. Must be suitable for gains 


0.4. Based on attractive visuals 


or} ww] & | 


0.5. Using for concretization 
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Considering the findings in Table 5 obtained based on the opinions of the members of the 
working group, it proves that agenda-setting theory-based practices and activities can be used 
functionally in the education process. It is seen that the opinions presented by the members of 
the study group as suggestions are grouped under five different sub-themes. Considering the 
findings given as sub-themes, it is observed that "applications and activities do not include 
orientation" come to the fore. In Table 5, sample opinions regarding the findings consisting of 
suggestions are given below. 


“The most important thing to consider when using agenda-based activities and practices in the 
education process is that these activities and practices do not cause learners to mislead. I think that 
activities and practices based on misdirection cause students to learn outside the course and outside the 
learning outcome.” (Primary School, Male Teacher, 3) 


“The most important step that should be taken as a priority in the use of activities and practices 
related to all the theories used in the education process, especially determining the target, is to be suitable 
for the learning outcomes of the course.” (High School, Female Teacher, 7) 


Discussion 


In the study, important conclusions have been reached that the reflections on the use 
of applications and activities prepared based on agenda-setting theory in education vary. It 
has turned out that the theory-based activities prepared do not cause any practical reflection 
in Turkey in terms of learning. This situation can be explained as the theory being based on 
transfer in a cognitive sense, as opposed to activities based on behavior change. This result 
obtained in the study is similar to the statement “agenda setting theory is based on verbal 
information transfer and awareness” emphasized in the study conducted by Maxwell and 
Donald (1993). In addition, the fact that the activities prepared in accordance with this theory 
do not reveal learning-based reflections due to the “immutability of the transmitted content” 
constitutes another of the important results achieved in the study. This result was obtained by 
Rogers and Dearing (2012) in their study, the content does not change in the transfers related 
to the general topics of agenda setting theory, but the transfer methods of the content vary 
according to the vehicle used, showing similarities with the statement. 

Another conclusion obtained from the research 1s that teachers have the idea that activities 
based on agenda setting support media-assisted learning, individual learning, creating a multi- 
learning environment and cooperative learning. individuals born in the 2000s and later are 
called Generation Z. Generation Z is a generation with a high awareness of the developments in 
the country and in the world (Kavalc1 & Unal, 2016). In this case, it is effective for the relevant 
generation to closely follow both traditional and new media tools. Indeed, digital platforms have 
reduced the threshold-keeping power of traditional media and potentially increase the capacity 
of various actors to shape the agenda (Gilardi et al., 2022). In this context, it is important 
that the agenda, which is shaped by both traditional and new media tools, is included in the 
educational process. In this context, it is said that activities based on agenda setting will have 
an impact on creating a multi-learning environment that allows many senses to be active in 
learning with individual and cooperative learning indicated by teachers. 

Another result of the research is that a significant part of the teachers see advertising 
content and political issues among the agenda-setting-based topics that cause perception 
Deceptions in the educational process. The media's agenda is effective in determining the 
public's agenda. The agenda is shaped by the media. However, the agenda set by the media can 
serve the purpose of certain institutions, individuals and commercial enterprises, and artificial 
agendas are formed. This situation causes perception illusions in the individual. Ads and 
political issues are influenced by them. Advertisements can be defined as sales through the 
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media. The main purpose of advertising is to increase sales (Pektas, 1987). For this purpose, 
various products are advertised through the media. However, the product presented by the media 
in the advertisements may not have the specified qualities. It can lead to perception illusions 
in political issues and actors determined by the media. As a matter of fact, the media sets the 
agenda, the media influences politics, economy, culture, etc. are guided by their prejudices on 
the issues (McCombs, 2005). This situation can be related to the approach of threshold keepers, 
who have an important influence on setting the agenda, to political issues by taking into account 
their personal values, the interests of the media organization to which they are affiliated and 
their focus on political power (Atabek, 1998). In this context, it is said that it is usual for 
teachers to see advertising content and political topics among the agenda-setting-based topics 
that cause perception deceptions in the educational process. 

It constitutes another result of the research that applications and activities based on 
agenda setting theory can be used functionally in the educational process. In this context, an 
important part of teachers attach importance to the fact that activities and practices based on 
agenda setting do not contain guidance and are appropriate for the student level. The basic 
assumption of the agenda-setting theory is that the media guides the individual and determines 
the limits of how much he will think about what (Murdock, 1975). In this context, it is said that 
the teachers' opinion that agenda-setting-based activities should not guide students is correct. 
At the same time, activities based on agenda setting should be appropriate for the cognitive and 
affective characteristics of the students, in other words, it should be appropriate for the student. 
It can be said that this situation is limited in that it affects the student's participation in relevant 
activities and practices. 


Conclusions and Implications 


In this study, which is based on the evaluation of the practices in the education process 
in the context of agenda setting theory, remarkable results have been reached. These results, 
which consist of the findings in Tables 1, 2,3 and 4, contain important clues regarding the use of 
agenda setting theory in education. In the study, activities and practices based on agenda setting; 
Remarkable results have been reached that students contribute to the learning process, that they 
cause illusions of perception in the learning process, that these illusions emerge under various 
topics, and that the reflections of the agenda setting theory in the practices in the education 
process in Turkey. 

As a result, it is said that the practical reflections of the activities prepared based on the 
theory of agenda setting in Turkey in the context of learning are not sufficient. Despite this, 
teachers have the opinion that it is important for the agenda-setting theory, which was put 
forward half a century ago, to find its own place in education. In this context, it is clear that 
there will be positive sides to the functional use of agenda-setting-based practices and activities 
in education. However, it is important to take into account some aspects, such as the student's 
level, age and course achievements, when applying these practices and activities in classes. 
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..."For a student attending the initial years of the high school, it is 
not easy to fully realize what a geometrical object is. While speaking, for 
example, of a triangle, the teacher will underline that its sides have 
length, but no width and no thickness. However, a pupil has never seen an 
object of this kind in his daily experience. For, every straight line has a 
width and a thickness, however minimal they may be. How can we 
introduce the geometrical objects and, immediately afterwards, the 
geometrical reasonings so that the learners can accept them not based on 
a sort of faith act but relying on a real understanding? The best method is 
to explain their conceptual genesis, also adding some historical 
elements’... 


Bussotti, P. (2024). Introduction to the geometrical 
objects and axioms: Conceptual, didactical and 
historical considerations. Problems of Education 
in the 21" Century, 82(3), 320-327. 158-161. 
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